-- Logs begin at Mon 2021-11-22 09:51:29 UTC, end at Mon 2021-11-22 10:55:07 UTC. -- Nov 22 10:26:30.579860 dv-cinder-804035-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 10:26:30.589128 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 10:26:30 2021] *** Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: nodename: dv-cinder-804035-13-iscsi Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: machine: x86_64 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: clock source: unix Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: pcre jit disabled Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: detected number of CPU cores: 4 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: current working directory: / Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: detected binary path: /usr/bin/uwsgi-core Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: your processes number limit is 47680 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: your memory page size is 4096 bytes Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: detected max file descriptor number: 2048 Nov 22 10:26:30.591192 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: lock engine: pthread robust mutexes Nov 22 10:26:30.592217 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: thunder lock: enabled Nov 22 10:26:30.592217 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 10:26:30.592217 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 10:26:30.637956 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: Python main interpreter initialized at 0x5638f8c359c0 Nov 22 10:26:30.637956 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: python threads support enabled Nov 22 10:26:30.637956 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: your server socket listen backlog is limited to 100 connections Nov 22 10:26:30.637956 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: your mercy for graceful operations on workers is 90 seconds Nov 22 10:26:30.638428 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 10:26:30.638428 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: *** Operational MODE: preforking *** Nov 22 10:26:30.638657 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: *** uWSGI is running in multiple interpreter mode *** Nov 22 10:26:30.638657 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: spawned uWSGI master process (pid: 102217) Nov 22 10:26:30.638891 dv-cinder-804035-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 10:26:30.640283 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: spawned uWSGI worker 1 (pid: 102218, cores: 1) Nov 22 10:26:30.640283 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: spawned uWSGI worker 2 (pid: 102219, cores: 1) Nov 22 10:26:30.640283 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 10:26:32.246622 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:26:32.246622 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: from cryptography.utils import int_from_bytes Nov 22 10:26:32.247339 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:26:32.247339 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: from cryptography.utils import int_from_bytes Nov 22 10:26:32.247800 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:26:32.247800 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: from cryptography.utils import int_from_bytes Nov 22 10:26:32.247929 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:26:32.247929 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: from cryptography.utils import int_from_bytes Nov 22 10:26:34.771285 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 10:26:34.771973 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 10:26:34.772340 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 10:26:34.772440 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 10:26:34.772511 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 10:26:34.772585 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 10:26:34.772653 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 10:26:34.772719 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 10:26:34.772794 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 10:26:34.772891 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 10:26:34.772963 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.773133 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.773224 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.773512 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.773763 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.773904 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774153 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774297 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774455 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774548 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774794 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.774936 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775082 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775172 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775433 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775564 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775786 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.775940 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776041 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776123 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776345 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776477 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776665 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-13-iscsi {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776811 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-13-iscsi {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.776986 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777116 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777293 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777423 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777601 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777745 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.777906 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778007 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778204 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778292 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778523 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778619 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.778918 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.779321 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.779427 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.780533 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.780668 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.780789 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.780926 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781049 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781179 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781307 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781436 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781556 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781675 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781794 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.781925 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782050 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782169 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782294 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782420 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782548 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782675 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782795 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.782914 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783033 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-13-iscsi {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783171 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-13-iscsi {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783300 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783421 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783571 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783710 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783832 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.783952 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784187 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784326 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784465 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784606 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784787 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.784909 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785112 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785241 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785434 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785568 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785741 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.785869 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786066 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786203 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786381 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786507 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786693 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.786832 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787014 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787140 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787311 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787445 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787618 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787784 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.787963 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788084 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788268 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788395 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788573 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788708 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788861 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.788987 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.789155 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.789290 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.789468 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.789642 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.789922 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790054 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790255 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790394 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790583 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790716 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790839 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.790965 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791102 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791238 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791369 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791491 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791690 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.791818 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792009 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792154 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792308 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792444 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792626 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792758 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.792923 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.793051 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.793238 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.793364 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.793543 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.793669 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794145 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794260 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794260 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794489 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794611 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794730 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794858 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.794984 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795105 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795230 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795350 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795468 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795625 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.795817 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796062 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796202 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796332 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796452 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796580 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796708 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.796932 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797060 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797250 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797385 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797544 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797685 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797867 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.797994 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798185 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798320 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798480 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798642 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798766 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.798892 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799092 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799228 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799404 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799530 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799765 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.799894 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800060 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800196 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800325 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800444 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800594 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800722 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.800906 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801033 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801224 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801350 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801524 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801650 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801834 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.801969 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802146 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802272 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802423 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802555 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802737 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.802863 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803044 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803171 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803348 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803481 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803633 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803770 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.803976 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804117 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804294 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804427 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804697 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804844 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.804966 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805217 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805360 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805613 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805613 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805854 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.805989 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806113 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806233 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806361 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806483 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806602 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806721 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.806840 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807030 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807170 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807339 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807477 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807638 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807824 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.807957 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808077 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808287 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808423 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808595 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808720 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.808896 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809034 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809221 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809350 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809522 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809648 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.809963 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810138 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810266 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810427 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810554 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810741 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.810876 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811056 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811182 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811358 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811484 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811645 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811842 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.811965 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812093 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812275 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812414 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812574 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812701 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.812883 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813009 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813188 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813309 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813487 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813613 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813788 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.813921 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814107 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814233 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814428 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814555 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814735 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.814869 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815047 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815172 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815355 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815481 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815648 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.815788 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:26:34.816024 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.816159 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.816350 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.816476 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.816690 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.816816 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817005 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817141 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817336 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817464 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817660 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817794 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.817981 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818121 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818294 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818422 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818604 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818731 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.818923 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819050 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819239 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819367 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819533 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819722 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819860 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.819983 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.820198 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.820399 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.820531 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.820660 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.820833 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821043 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821182 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821367 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821500 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821692 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.821827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822015 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822148 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822333 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822457 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822658 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822792 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.822978 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823108 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823289 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823407 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823603 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823765 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.823978 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824101 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824285 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824410 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824609 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824738 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.824961 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825152 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825295 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825419 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825552 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825675 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.825877 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826057 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826191 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826328 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826535 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826659 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826781 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.826900 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827097 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827275 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827425 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827551 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827712 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.827837 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828049 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828205 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828331 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828452 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828649 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828838 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.828973 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829108 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829235 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829363 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829486 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829605 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.829841 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830033 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830180 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830316 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830440 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830560 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830790 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.830975 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831111 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831247 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831378 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831508 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831648 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831807 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.831928 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832061 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832269 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832449 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832596 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832723 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832845 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.832966 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833158 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833298 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833458 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833579 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833759 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.833888 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834076 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834206 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834369 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834499 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834683 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834819 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.834972 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835108 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835293 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835421 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835603 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835785 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.835998 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836172 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836305 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836436 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836571 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836694 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.836892 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837030 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837228 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837357 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837561 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837690 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.837867 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838004 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838189 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838317 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838513 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838649 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838829 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.838965 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839143 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839272 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839433 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839565 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839763 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.839894 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840078 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840206 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840386 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840518 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840684 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840812 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.840995 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841128 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841306 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841441 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841580 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841701 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.841896 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842022 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842201 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842328 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842512 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842650 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842804 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.842930 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843117 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843260 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843412 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843540 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843749 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.843890 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844063 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844201 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844385 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844520 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844702 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.844827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845049 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845185 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845373 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845501 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845695 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.845821 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846005 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846145 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846328 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846455 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846640 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846768 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.846956 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847084 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847267 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847394 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847579 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847722 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.847896 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848024 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848226 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848360 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848540 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848668 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848847 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.848974 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849168 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849294 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849477 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849611 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849799 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.849951 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850078 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850214 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850399 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850538 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850718 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.850845 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851058 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851182 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851374 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851532 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851748 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.851876 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852063 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852193 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852379 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852513 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852692 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.852823 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853005 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853136 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853316 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853450 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853629 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853754 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.853949 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854099 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854259 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854388 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854582 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854720 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.854901 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855010 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855213 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855342 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855520 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855651 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855865 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.855990 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856173 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856285 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856480 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856582 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856803 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.856890 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.857140 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.857241 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.857442 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.857518 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858376 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858470 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858561 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858669 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858758 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858844 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.858929 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859017 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859104 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859184 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859261 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859345 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859528 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859624 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859866 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.859955 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860185 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860273 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860496 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860592 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860807 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.860890 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.861113 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.861199 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.861418 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.861511 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862064 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862161 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862370 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862456 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862674 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862761 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.862976 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863074 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863294 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863386 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863601 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863715 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.863946 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864031 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864266 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864351 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864573 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864676 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864880 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.864965 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865190 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865280 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865496 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865582 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865799 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.865886 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866101 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866186 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866406 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866500 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866712 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.866798 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867062 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867210 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867494 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867581 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867840 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.867931 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868161 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868260 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868469 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868554 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868785 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.868879 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869097 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869192 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869408 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869495 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869722 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.869806 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870031 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870117 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870343 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870429 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870654 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870738 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.870962 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871047 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871273 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871358 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871581 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871684 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.871926 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872015 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872239 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872324 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872551 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872645 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872857 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.872951 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873162 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873265 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873469 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873563 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873783 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.873867 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.874101 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.874367 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.874678 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.874775 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875004 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875097 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875321 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875414 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875641 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875852 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.875983 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876084 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876306 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876437 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876630 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876762 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.876945 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877071 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877250 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877376 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877554 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877678 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877856 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.877988 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878161 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878285 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878469 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878597 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878763 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.878894 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879067 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879190 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879368 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879493 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879688 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879826 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.879993 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880121 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880297 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880424 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880600 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880724 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.880937 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881078 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881241 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881454 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881593 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881721 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881850 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.881972 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882128 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882260 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882440 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882565 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882780 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.882911 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883087 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883219 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883392 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883518 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883730 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.883867 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884081 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884218 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884386 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884513 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884729 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.884855 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885055 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885192 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885381 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885504 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885686 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885817 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.885996 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886130 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886317 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886442 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886623 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886755 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.886926 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887059 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887227 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887353 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887530 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887654 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887863 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.887998 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888166 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888291 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888467 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888598 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888772 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.888897 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889082 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889205 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889386 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889509 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889687 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889813 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.889987 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890119 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890286 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890417 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890591 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890716 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.890894 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891018 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891195 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891337 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891497 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891630 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.891959 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892136 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892274 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892437 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892562 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892741 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.892864 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893041 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893179 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893347 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893477 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893647 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893770 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.893949 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894083 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894251 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894381 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894556 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894687 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894867 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.894990 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895167 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895292 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895473 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895604 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895818 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.895942 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896123 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896248 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896427 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896549 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896733 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.896859 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897032 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897163 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897336 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897461 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897640 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897772 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.897961 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898091 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898292 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898459 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898639 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898763 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.898948 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899072 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899266 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899400 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899566 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899721 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.899897 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900022 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900204 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900340 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900506 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900629 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900810 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.900933 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901109 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901241 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901410 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901536 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901712 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.901844 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902012 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902137 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902329 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902452 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902632 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902750 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.902934 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903058 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903232 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903363 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903539 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903695 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.903889 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904018 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904203 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904326 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904547 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904671 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904856 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.904995 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905164 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905287 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905469 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905609 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905780 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.905905 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906092 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906222 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906393 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906525 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906700 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.906825 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907008 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907131 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907322 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907458 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907621 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907798 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.907932 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908055 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908251 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908454 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908577 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908705 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908857 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.908989 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909174 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909311 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909495 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909619 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909818 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.909945 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910123 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910249 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910433 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910555 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910739 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.910861 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911047 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911174 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911356 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911479 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911684 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911820 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.911991 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912118 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912301 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912434 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912613 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912737 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.912920 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913045 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913227 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913363 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913533 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913667 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913837 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.913987 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.914206 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.914331 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.914512 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.914644 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.914912 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915030 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915153 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915280 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915408 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915540 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915726 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.915853 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916034 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916161 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916342 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916470 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916647 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916779 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.916951 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917081 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917381 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917505 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917692 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917815 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.917998 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918120 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918303 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918435 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918611 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918733 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.918923 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919056 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919236 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919360 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919543 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919693 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.919881 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920005 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920282 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920407 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920593 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920718 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.920905 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921038 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921211 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921336 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921518 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921643 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921831 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.921968 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922154 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922285 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922464 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922589 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922772 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.922905 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923078 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923202 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923385 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923523 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923717 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.923857 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924040 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924163 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924370 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924501 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924752 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.924876 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925059 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925184 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925380 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925506 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925767 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.925890 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926078 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926203 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926397 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926521 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926715 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.926839 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927035 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927159 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927344 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927468 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927654 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927796 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.927984 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928106 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928296 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928431 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928616 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928739 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.928927 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.929051 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.929237 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.929371 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.929589 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.929824 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930010 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930135 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930257 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930389 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930563 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930689 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.930884 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931024 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931210 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931377 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931626 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931823 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.931969 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932101 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932279 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932404 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932606 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932739 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.932931 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933055 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933236 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933360 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933544 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933676 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933851 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.933975 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934154 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934277 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934464 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934597 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934772 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.934895 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935083 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935209 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935391 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935522 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935727 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.935868 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936034 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936167 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936339 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936472 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936659 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936792 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.936963 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937097 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937292 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937423 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937600 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937723 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.937917 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938053 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938234 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938364 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938540 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938665 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.938872 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939010 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939141 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939272 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939448 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939573 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939775 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.939919 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940078 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940203 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940380 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940505 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940707 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.940831 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941017 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941141 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941341 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941475 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941665 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941789 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.941974 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942100 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942290 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942422 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942617 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942741 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.942932 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943056 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943246 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943370 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943574 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943723 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.943903 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944035 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944210 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944350 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944517 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944641 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944825 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.944957 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945126 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945302 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945486 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945613 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945795 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.945908 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946103 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946456 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946456 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946707 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946707 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.946924 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947052 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947183 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947305 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947424 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947578 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947756 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.947915 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948042 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948219 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948344 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948525 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948650 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948827 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.948953 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949126 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949262 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949457 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949580 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949772 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.949896 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950095 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950220 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950416 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950540 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950738 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.950864 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951045 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951168 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951366 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951498 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951691 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.951821 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952014 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952143 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952328 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952463 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952641 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952773 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.952955 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953079 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953267 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953471 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953596 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953716 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953874 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.953998 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954184 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954316 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954494 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954618 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954806 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.954930 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.955128 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.955366 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.955700 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.955831 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956033 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956159 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956347 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956481 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956659 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956782 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.956968 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957092 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957280 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957412 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957587 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957710 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.957898 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958033 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958205 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958324 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958513 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958644 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958827 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.958962 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959144 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959269 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959466 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959607 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959803 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.959936 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960121 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960256 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960436 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960561 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960756 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.960960 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961136 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961265 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961395 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961517 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961713 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.961839 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962019 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962147 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962326 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962459 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962638 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962762 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.962952 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963078 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963264 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963400 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963573 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963723 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.963909 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964035 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964219 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964357 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964532 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964657 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964848 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.964977 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965162 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965289 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965475 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965599 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965792 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.965917 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966121 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966245 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966442 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966568 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966756 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.966890 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967067 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967192 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967380 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967516 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967715 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.967939 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.968235 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.968362 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.968555 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.968689 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.968890 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969046 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969211 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969334 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969532 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969658 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969852 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.969986 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970166 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970298 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970470 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970595 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970776 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.970910 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971084 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971242 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971392 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971515 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971718 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.971865 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972026 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972150 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972346 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972469 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972653 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972754 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.972957 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.973052 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.973269 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.973372 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.973579 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.973800 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974121 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974217 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974450 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974543 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974781 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.974877 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975103 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975198 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975421 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975525 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975759 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.975862 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976072 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976178 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976375 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976588 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976774 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.976870 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977054 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977204 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977377 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977512 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977694 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.977829 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978005 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978141 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978318 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978463 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978635 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978761 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.978945 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979078 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979251 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979383 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979553 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979718 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.979896 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980020 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980205 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980338 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980511 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980636 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980818 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.980949 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981129 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981256 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981430 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981553 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981733 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.981859 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982036 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982167 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982338 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982462 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982641 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982779 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.982941 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983066 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983250 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983380 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983553 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983725 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.983893 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984018 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984201 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984326 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984511 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984643 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984820 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.984944 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985126 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985249 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985436 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985569 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985742 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.985868 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.986045 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.986171 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.986364 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.986490 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987002 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987130 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987318 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987443 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987632 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987834 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.987965 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.988093 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.988304 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.988434 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.988622 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.988848 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989162 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989288 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989538 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989663 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989867 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.989993 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990210 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990341 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990521 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990727 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990853 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.990989 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991113 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991234 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991430 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991564 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991766 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.991893 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992135 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992301 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992466 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992599 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992784 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.992917 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993102 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993228 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993416 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993544 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993732 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.993860 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994050 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994176 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994365 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994493 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994663 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994795 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.994983 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995109 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995327 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995455 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995641 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995793 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.995984 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996122 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996303 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996438 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996618 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996744 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.996930 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997064 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997237 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997368 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997546 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997663 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.997859 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998004 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998180 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998306 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998489 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998613 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998797 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.998925 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.999108 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.999233 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.999523 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.999648 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:34.999910 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000038 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000241 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000379 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000562 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000694 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.000888 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001016 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001213 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001339 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001526 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001652 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001839 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.001966 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002150 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002275 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002467 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002600 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002801 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.002929 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003128 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003253 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003454 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003593 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003784 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.003911 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004092 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004218 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004399 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004538 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004713 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.004850 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005048 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005184 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005354 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005480 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005672 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005805 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.005991 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006123 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006300 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006426 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006617 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006748 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.006925 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007057 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007239 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007365 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007557 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007744 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.007975 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008105 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008290 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008419 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008624 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008750 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.008937 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009071 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009247 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009382 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009559 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009684 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.009869 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010000 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010180 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010304 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010489 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010613 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010801 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.010933 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011126 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011251 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011435 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011569 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011765 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.011890 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012086 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012212 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012404 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012529 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012723 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.012850 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013035 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013168 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013344 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013481 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013660 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013786 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.013972 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014096 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014282 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014415 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014593 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014725 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.014909 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015035 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015224 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015356 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015543 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015700 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.015889 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016014 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016215 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016357 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016540 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016665 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016871 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.016999 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017181 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017313 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017520 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017665 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017844 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.017968 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018162 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018289 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018474 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018599 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018779 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.018904 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.019024 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 10:26:35.019147 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:26:35.019324 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102219) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 10:26:35.042796 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_db.sqlalchemy.engines [None req-eefd0336-d579-4c16-a142-aea08747692b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.043718 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.109837 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.context [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591e4b4b-d12e-4b86-9966-9fa5b93cdbbd(cell1) {{(pid=102218) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 10:26:35.110453 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.context [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591e4b4b-d12e-4b86-9966-9fa5b93cdbbd(cell1) {{(pid=102219) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 10:26:35.114464 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_concurrency.lockutils [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:26:35.114967 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:26:35.116071 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_concurrency.lockutils [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:26:35.116576 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:26:35.116915 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_concurrency.lockutils [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:26:35.117442 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:26:35.119121 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_concurrency.lockutils [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102218) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:26:35.119371 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:26:35.129798 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_db.sqlalchemy.engines [None req-eefd0336-d579-4c16-a142-aea08747692b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.133186 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.135545 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_db.sqlalchemy.engines [None req-eefd0336-d579-4c16-a142-aea08747692b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.140610 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.402635 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG oslo_db.sqlalchemy.engines [None req-eefd0336-d579-4c16-a142-aea08747692b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.407848 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102219) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:26:35.751056 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: WARNING keystonemiddleware.auth_token [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:26:35.751822 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: WARNING keystonemiddleware.auth_token [None req-eefd0336-d579-4c16-a142-aea08747692b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:26:35.757554 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: WARNING keystonemiddleware.auth_token [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:26:35.758452 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: WARNING keystonemiddleware.auth_token [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:26:35.978331 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: WARNING keystonemiddleware.auth_token [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:26:35.979111 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: WARNING keystonemiddleware.auth_token [None req-eefd0336-d579-4c16-a142-aea08747692b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:26:35.983560 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: WARNING keystonemiddleware.auth_token [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:26:35.984437 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: WARNING keystonemiddleware.auth_token [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:26:35.989289 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638f8c359c0 pid: 102219 (default app) Nov 22 10:26:35.990172 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5638f8c359c0 pid: 102218 (default app) Nov 22 10:26:35.991338 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:26:35.992647 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8cf23c8d-ce3c-45be-ab08-58e5cd041f3d None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001827 Nov 22 10:26:35.993054 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Mon Nov 22 10:26:35 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:27:58.202329 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:27:58.204305 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-eefd0336-d579-4c16-a142-aea08747692b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002888 Nov 22 10:27:58.207853 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:27:58 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:27:58.772796 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-62c968d6-f4ca-4316-a6ba-d07553009b9e admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:27:58.802384 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-62c968d6-f4ca-4316-a6ba-d07553009b9e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.589724 Nov 22 10:27:58.803303 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Mon Nov 22 10:27:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:28:01.183473 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-eefd0336-d579-4c16-a142-aea08747692b None None] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:01.184526 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-eefd0336-d579-4c16-a142-aea08747692b None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 22 10:28:01.185505 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:01.256033 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-f7a8f109-9e4b-4111-bc18-800a7966c2fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "swap": 0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:01.275694 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:28:01.275694 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:28:01.308179 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-f7a8f109-9e4b-4111-bc18-800a7966c2fe admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115320 Nov 22 10:28:01.309439 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:01 2021] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:01.653647 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-58e5d20a-2ce0-4fdc-b730-4c2933edecbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:01.656080 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:28:01.656080 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: warnings.warn(msg) Nov 22 10:28:01.709657 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-58e5d20a-2ce0-4fdc-b730-4c2933edecbd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.391086 Nov 22 10:28:01.712320 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Mon Nov 22 10:28:01 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:04.113359 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-f7a8f109-9e4b-4111-bc18-800a7966c2fe admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:04.114727 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-f7a8f109-9e4b-4111-bc18-800a7966c2fe admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Nov 22 10:28:04.115143 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:04.241232 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-8a3fc834-dfd1-4426-bff7-aa6ba0ce0143 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "ram": 512}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:04.260752 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:28:04.260752 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: warnings.warn(msg) Nov 22 10:28:04.282686 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-8a3fc834-dfd1-4426-bff7-aa6ba0ce0143 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160283 Nov 22 10:28:04.283542 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:04 2021] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:04.296053 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-aaaa9191-c5fe-42e7-bbfc-b7fba21c6073 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:04.297538 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:28:04.297538 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:28:04.333244 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-aaaa9191-c5fe-42e7-bbfc-b7fba21c6073 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041082 Nov 22 10:28:04.334255 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Mon Nov 22 10:28:04 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:06.692676 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-8a3fc834-dfd1-4426-bff7-aa6ba0ce0143 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:06.693833 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-8a3fc834-dfd1-4426-bff7-aa6ba0ce0143 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Nov 22 10:28:06.694429 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:06.758024 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-edb6dd0e-a36c-4d3b-98ba-7b806787146c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:06.780661 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-edb6dd0e-a36c-4d3b-98ba-7b806787146c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078680 Nov 22 10:28:06.786364 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:06.794409 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-9ce30046-12bd-430a-ad1a-57911e74fe74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:06.824592 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-9ce30046-12bd-430a-ad1a-57911e74fe74 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034452 Nov 22 10:28:06.825643 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Mon Nov 22 10:28:06 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:28:09.265171 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-edb6dd0e-a36c-4d3b-98ba-7b806787146c admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:09.266827 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-edb6dd0e-a36c-4d3b-98ba-7b806787146c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 22 10:28:09.266827 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:09.340937 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-1eac1b79-b0f3-43f2-88f2-fdfbf857b360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "id": "d3", "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:09.368974 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-1eac1b79-b0f3-43f2-88f2-fdfbf857b360 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094868 Nov 22 10:28:09.369548 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:09.383214 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-edb42646-822e-4f85-a5ba-6679220280c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:09.409712 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-edb42646-822e-4f85-a5ba-6679220280c6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031210 Nov 22 10:28:09.410982 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Mon Nov 22 10:28:09 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:11.776909 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-1eac1b79-b0f3-43f2-88f2-fdfbf857b360 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:11.777943 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-1eac1b79-b0f3-43f2-88f2-fdfbf857b360 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 22 10:28:11.778368 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:11.839628 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:11.861472 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076502 Nov 22 10:28:11.862043 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:11 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:11.874804 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-a01687ba-f7bd-44b9-87fc-e43bdf32573e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:11.900842 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-a01687ba-f7bd-44b9-87fc-e43bdf32573e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029483 Nov 22 10:28:11.904034 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Mon Nov 22 10:28:11 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:14.261235 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:14.262288 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Nov 22 10:28:14.262732 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:14.333491 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-f249bf0d-aa58-4e35-9709-585b9c5cc838 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:14.360046 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-f249bf0d-aa58-4e35-9709-585b9c5cc838 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088121 Nov 22 10:28:14.360585 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Mon Nov 22 10:28:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:17.196240 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:17.197152 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-17d0dd93-e9a3-48a3-9191-7b8d15e7e954 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Nov 22 10:28:17.197569 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:17.261036 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-fad22d40-cdd7-47e7-bbd5-fb63a6d25789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "id": "1"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:17.286606 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-fad22d40-cdd7-47e7-bbd5-fb63a6d25789 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081896 Nov 22 10:28:17.287362 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:17 2021] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:17.300575 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-74c3b10e-f404-47ee-8653-6924b2da0272 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:17.328645 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-74c3b10e-f404-47ee-8653-6924b2da0272 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031704 Nov 22 10:28:17.329332 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Mon Nov 22 10:28:17 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:19.750131 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-fad22d40-cdd7-47e7-bbd5-fb63a6d25789 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:19.751238 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-fad22d40-cdd7-47e7-bbd5-fb63a6d25789 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Nov 22 10:28:19.751625 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:19 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:19.813612 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-d0a00169-df22-4981-a66c-20667caa7b1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:19.834516 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-d0a00169-df22-4981-a66c-20667caa7b1a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075500 Nov 22 10:28:19.835039 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:19 2021] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:19.847733 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-8b32aa96-3b44-419d-bed2-7f4ed9aba272 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:19.872882 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-8b32aa96-3b44-419d-bed2-7f4ed9aba272 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028881 Nov 22 10:28:19.873467 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Mon Nov 22 10:28:19 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:28:22.216243 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-d0a00169-df22-4981-a66c-20667caa7b1a admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:22.217805 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-d0a00169-df22-4981-a66c-20667caa7b1a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Nov 22 10:28:22.218496 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:22.287968 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-e04415a5-c2d0-4d6c-9439-d549ff8e19d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:22.309098 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-e04415a5-c2d0-4d6c-9439-d549ff8e19d8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082642 Nov 22 10:28:22.309654 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:22 2021] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:28:22.322818 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8569718c-932a-4e6c-be08-e5ca48b8e4b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:22.350494 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8569718c-932a-4e6c-be08-e5ca48b8e4b3 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031402 Nov 22 10:28:22.351111 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Mon Nov 22 10:28:22 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:24.755296 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-e04415a5-c2d0-4d6c-9439-d549ff8e19d8 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:24.756425 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-e04415a5-c2d0-4d6c-9439-d549ff8e19d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Nov 22 10:28:24.756836 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:24.827232 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-a14e913a-83de-45bd-88f8-82f2844d73a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "disk": 80, "swap": 0, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:24.855542 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-a14e913a-83de-45bd-88f8-82f2844d73a1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092171 Nov 22 10:28:24.856350 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:24 2021] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:24.872856 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d76737b5-1587-438f-8559-052b937d3f73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:24.899803 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d76737b5-1587-438f-8559-052b937d3f73 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034109 Nov 22 10:28:24.900801 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Mon Nov 22 10:28:24 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:28:27.292872 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-a14e913a-83de-45bd-88f8-82f2844d73a1 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:27.293897 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-a14e913a-83de-45bd-88f8-82f2844d73a1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 22 10:28:27.294316 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:27.358946 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:27.379695 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.078741 Nov 22 10:28:27.380864 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Mon Nov 22 10:28:27 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:27.393249 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-24d9d990-d94b-4cb8-aff2-6eab7250a6f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:27.418581 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-24d9d990-d94b-4cb8-aff2-6eab7250a6f2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029375 Nov 22 10:28:27.419520 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Mon Nov 22 10:28:27 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:28:48.731007 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:48.732248 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002029 Nov 22 10:28:48.732667 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:28:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:48.796506 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-558bb2ff-8296-4233-83ee-036694af9244 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:48.813933 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-558bb2ff-8296-4233-83ee-036694af9244 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072286 Nov 22 10:28:48.814470 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Mon Nov 22 10:28:48 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:50.320654 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:50.321725 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d108ae85-1200-49b1-91a1-a4c58902fb2c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 22 10:28:50.322132 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:50.514552 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-966d8943-d010-4325-a2bf-ec93a7b5a359 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:50.521561 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.wsgi [None req-966d8943-d010-4325-a2bf-ec93a7b5a359 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 10:28:50.521561 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-966d8943-d010-4325-a2bf-ec93a7b5a359 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:50.522410 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-966d8943-d010-4325-a2bf-ec93a7b5a359 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062902 Nov 22 10:28:50.523744 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Nov 22 10:28:50 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:50.536767 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-a5eec5c2-a6d0-4438-af57-2be9852ccf2c admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:50.558399 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-a5eec5c2-a6d0-4438-af57-2be9852ccf2c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025688 Nov 22 10:28:50.558994 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:50.572779 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8639620f-b5ae-432a-bc9e-113c44b0f69d admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:50.595873 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8639620f-b5ae-432a-bc9e-113c44b0f69d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026560 Nov 22 10:28:50.596452 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:50.607071 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-a39c85a4-d2a6-4821-aa01-66c31dfea355 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:50.613452 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.wsgi [None req-a39c85a4-d2a6-4821-aa01-66c31dfea355 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 10:28:50.614086 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-a39c85a4-d2a6-4821-aa01-66c31dfea355 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:50.615040 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-a39c85a4-d2a6-4821-aa01-66c31dfea355 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011590 Nov 22 10:28:50.615541 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Nov 22 10:28:50 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:52.029973 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8639620f-b5ae-432a-bc9e-113c44b0f69d admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:52.031022 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8639620f-b5ae-432a-bc9e-113c44b0f69d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 22 10:28:52.031471 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:52.229483 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d2415911-620d-4d4c-9b57-52be54ec0873 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:52.236471 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.wsgi [None req-d2415911-620d-4d4c-9b57-52be54ec0873 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 10:28:52.237051 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d2415911-620d-4d4c-9b57-52be54ec0873 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:52.237878 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d2415911-620d-4d4c-9b57-52be54ec0873 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064133 Nov 22 10:28:52.238384 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Nov 22 10:28:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:52.249172 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-ee6e0856-3132-4ed5-9302-5476bf2d7242 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:52.263486 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-ee6e0856-3132-4ed5-9302-5476bf2d7242 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018421 Nov 22 10:28:52.264093 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:52.274840 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d8d7dffd-1fb9-495a-b39d-561001665005 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:52.289279 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d8d7dffd-1fb9-495a-b39d-561001665005 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018014 Nov 22 10:28:52.289874 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:52 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:52.303249 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-5a4182e6-2606-4f71-bc80-65f88c4affbf admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:52.309210 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.wsgi [None req-5a4182e6-2606-4f71-bc80-65f88c4affbf admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 10:28:52.309779 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-5a4182e6-2606-4f71-bc80-65f88c4affbf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:52.310620 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-5a4182e6-2606-4f71-bc80-65f88c4affbf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012290 Nov 22 10:28:52.311125 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Mon Nov 22 10:28:52 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:53.747777 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d8d7dffd-1fb9-495a-b39d-561001665005 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:53.748993 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d8d7dffd-1fb9-495a-b39d-561001665005 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Nov 22 10:28:53.749439 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:53.945689 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-e76b07f2-3d0d-4907-b4df-36e09ec6d978 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:53.951232 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.wsgi [None req-e76b07f2-3d0d-4907-b4df-36e09ec6d978 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 10:28:53.951838 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-e76b07f2-3d0d-4907-b4df-36e09ec6d978 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102219) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:53.952640 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-e76b07f2-3d0d-4907-b4df-36e09ec6d978 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063672 Nov 22 10:28:53.953164 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:28:53 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:53.963539 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-7361ea72-bfdd-446f-aa97-32181fb88d83 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:53.977870 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-7361ea72-bfdd-446f-aa97-32181fb88d83 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017889 Nov 22 10:28:53.978569 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:28:53.990165 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:54.003521 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017769 Nov 22 10:28:54.004120 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Mon Nov 22 10:28:53 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:28:54.014945 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-324ad552-463d-4d21-adea-474778303117 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:54.020949 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.wsgi [None req-324ad552-463d-4d21-adea-474778303117 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 10:28:54.021514 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-324ad552-463d-4d21-adea-474778303117 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102218) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:28:54.022312 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-324ad552-463d-4d21-adea-474778303117 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011089 Nov 22 10:28:54.022841 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:28:54 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 10:28:55.439931 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:55.441006 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Nov 22 10:28:55.441418 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:55.648299 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-ec533994-19ef-4da6-a08b-88289f7f2ab2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:55.675125 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-ec533994-19ef-4da6-a08b-88289f7f2ab2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.093726 Nov 22 10:28:55.675708 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Nov 22 10:28:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:57.113961 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:57.115012 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Nov 22 10:28:57.115687 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:57.314201 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-f3fa7bb0-b1ad-46f4-8fc0-0a740bfa3845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:57.334357 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-f3fa7bb0-b1ad-46f4-8fc0-0a740bfa3845 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077100 Nov 22 10:28:57.334917 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Nov 22 10:28:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:28:58.751873 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:28:58.753021 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Nov 22 10:28:58.753437 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:28:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:28:58.954386 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-ce42fa9e-8a6b-4935-aeaf-162273f29fec admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:28:58.976146 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-ce42fa9e-8a6b-4935-aeaf-162273f29fec admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.079161 Nov 22 10:28:58.976710 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Nov 22 10:28:58 2021] POST /compute/v2.1/flavors => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:29:00.405835 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:00.406857 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 22 10:29:00.407223 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:29:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:29:00.607409 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-4e8e91ed-05ab-4f32-93b8-b4374e183010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:29:00.628992 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-4e8e91ed-05ab-4f32-93b8-b4374e183010 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.079299 Nov 22 10:29:00.629490 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Mon Nov 22 10:29:00 2021] POST /compute/v2.1/flavors => generated 409 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:29:02.049309 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:02.050433 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Nov 22 10:29:02.050814 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:29:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:29:02.250290 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d071f352-a6e8-419a-8e94-1a072b2b2dbd admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:02.270235 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d071f352-a6e8-419a-8e94-1a072b2b2dbd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080116 Nov 22 10:29:02.270783 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Mon Nov 22 10:29:02 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:29:49.357748 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.359169 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-8a0a889d-c0af-4f17-aaf2-39c7394229c3 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 22 10:29:49.359574 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:29:49.421192 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-bb3240b3-42af-49d9-809f-e8d05670227c admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.440834 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-bb3240b3-42af-49d9-809f-e8d05670227c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074543 Nov 22 10:29:49.441348 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:29:49.464633 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-923896ca-1dc2-4ab7-a102-d6eb7b12bead admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.481313 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-923896ca-1dc2-4ab7-a102-d6eb7b12bead admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020337 Nov 22 10:29:49.481879 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:29:49.494911 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-91c03d83-51c8-48b8-91b8-4cc089f76f59 admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.503229 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-91c03d83-51c8-48b8-91b8-4cc089f76f59 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012283 Nov 22 10:29:49.503803 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:29:49.516137 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-78a5983e-cfac-4f62-b144-67f7dc9644a9 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.524614 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-78a5983e-cfac-4f62-b144-67f7dc9644a9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012124 Nov 22 10:29:49.525186 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:29:49.538086 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:29:49.546932 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012320 Nov 22 10:29:49.547397 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Mon Nov 22 10:29:49 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:31:14.641789 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-26fe19dc-3c2a-4d86-9c58-6c1c44db94ff tempest-verify_tempest_config-1320234269 tempest-verify_tempest_config-1320234269-project] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:31:14.643836 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-26fe19dc-3c2a-4d86-9c58-6c1c44db94ff tempest-verify_tempest_config-1320234269 tempest-verify_tempest_config-1320234269-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.117909 Nov 22 10:31:14.644385 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1133 bytes} [Mon Nov 22 10:31:14 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:32:45.269761 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:45.270786 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Nov 22 10:32:45.271178 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:32:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:32:45.536753 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:45.537971 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:32:45.537971 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:32:45.539925 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:45.540360 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:45.541165 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:45.541583 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:45.576092 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-2e48f3f1-aeeb-4e55-b4db-6121ebb38208 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.163465 Nov 22 10:32:45.576668 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 36/71] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:32:45 2021] GET /compute/v2.1/os-services => generated 794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:32:47.014492 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:47.016274 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002261 Nov 22 10:32:47.016683 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:32:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:32:47.211854 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:47.213036 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:32:47.213036 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:32:47.214576 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:47.215113 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:47.215868 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:47.216315 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:47.241253 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-abd58f30-8b5a-4220-9abd-c5edf04a4814 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083353 Nov 22 10:32:47.241893 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:32:47 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:32:59.083356 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:59.084403 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Nov 22 10:32:59.084802 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:32:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:32:59.287485 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:32:59.289420 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:32:59.289420 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:32:59.290927 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:59.291363 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:59.292183 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:32:59.292600 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:32:59.313865 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-85bf3a1a-356d-4ae4-9ef1-0128e486b9df admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.084141 Nov 22 10:32:59.314438 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 38/75] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:32:59 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:33:00.755489 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: DEBUG nova.api.openstack.wsgi [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] Calling method '>' {{(pid=102218) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:33:00.756671 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: INFO nova.api.openstack.requestlog [None req-d1ee2f7a-e8b3-4c3e-be54-abc43735f21f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Nov 22 10:33:00.757195 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: [pid: 102218|app: 0|req: 38/76] 10.222.0.46 () {56 vars in 1074 bytes} [Mon Nov 22 10:33:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:33:00.953608 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG nova.api.openstack.wsgi [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] Calling method '>' {{(pid=102219) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:33:00.954753 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:33:00.954753 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: warnings.warn(msg) Nov 22 10:33:00.956325 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:33:00.956809 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:33:00.957595 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:33:00.958019 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: DEBUG oslo_concurrency.lockutils [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102219) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:33:00.980756 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: INFO nova.api.openstack.requestlog [None req-b6e4fa92-0717-41fa-9630-2bb6a7d8aebe admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081685 Nov 22 10:33:00.981333 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: [pid: 102219|app: 0|req: 39/77] 10.222.0.46 () {60 vars in 1193 bytes} [Mon Nov 22 10:33:00 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:33:58.530208 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: Mon Nov 22 10:33:58 2021 - graceful shutdown triggered... Nov 22 10:33:58.530870 dv-cinder-804035-13-iscsi devstack@n-api.service[102218]: Gracefully killing worker 1 (pid: 102218)... Nov 22 10:33:58.531343 dv-cinder-804035-13-iscsi devstack@n-api.service[102219]: Gracefully killing worker 2 (pid: 102219)... Nov 22 10:33:58.531056 dv-cinder-804035-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 22 10:33:59.532003 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: worker 1 buried after 1 seconds Nov 22 10:33:59.532003 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: worker 2 buried after 1 seconds Nov 22 10:33:59.532003 dv-cinder-804035-13-iscsi devstack@n-api.service[102217]: goodbye to uWSGI. Nov 22 10:33:59.533640 dv-cinder-804035-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 22 10:33:59.534223 dv-cinder-804035-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 22 10:33:59.537236 dv-cinder-804035-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 10:33:59.547624 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 10:33:59 2021] *** Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: nodename: dv-cinder-804035-13-iscsi Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: machine: x86_64 Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: clock source: unix Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: pcre jit disabled Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: detected number of CPU cores: 4 Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: current working directory: / Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: detected binary path: /usr/bin/uwsgi-core Nov 22 10:33:59.549778 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: your processes number limit is 47680 Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: your memory page size is 4096 bytes Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: detected max file descriptor number: 2048 Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: lock engine: pthread robust mutexes Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: thunder lock: enabled Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 10:33:59.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 10:33:59.596096 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: Python main interpreter initialized at 0x55e3bf2149c0 Nov 22 10:33:59.596096 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: python threads support enabled Nov 22 10:33:59.596096 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: your server socket listen backlog is limited to 100 connections Nov 22 10:33:59.596096 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: your mercy for graceful operations on workers is 90 seconds Nov 22 10:33:59.596584 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 10:33:59.596584 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: *** Operational MODE: preforking *** Nov 22 10:33:59.596854 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: *** uWSGI is running in multiple interpreter mode *** Nov 22 10:33:59.596854 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: spawned uWSGI master process (pid: 122840) Nov 22 10:33:59.597079 dv-cinder-804035-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 10:33:59.597825 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: spawned uWSGI worker 1 (pid: 122857, cores: 1) Nov 22 10:33:59.598058 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: spawned uWSGI worker 2 (pid: 122858, cores: 1) Nov 22 10:33:59.601308 dv-cinder-804035-13-iscsi devstack@n-api.service[122840]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 10:34:01.389236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:34:01.389236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: from cryptography.utils import int_from_bytes Nov 22 10:34:01.389968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:34:01.389968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: from cryptography.utils import int_from_bytes Nov 22 10:34:01.394737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:34:01.394737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: from cryptography.utils import int_from_bytes Nov 22 10:34:01.395296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 10:34:01.395296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: from cryptography.utils import int_from_bytes Nov 22 10:34:03.755237 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 10:34:03.756151 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 10:34:03.756874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 10:34:03.757250 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 10:34:03.757478 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 10:34:03.757881 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.758229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.758531 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.758855 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.759222 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.759541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.759992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.760354 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.760663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.760955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.761277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.761606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-13-iscsi {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.761935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.762247 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.762564 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.762873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.763177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.763504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.763834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.764356 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.765288 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 10:34:03.765737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 10:34:03.766117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.766257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 10:34:03.766333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.766403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 10:34:03.766589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.766710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 10:34:03.766887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.766998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.767237 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.767381 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.767575 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.767860 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.768098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.768299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.768531 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.768747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.768747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.769167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.769382 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.769606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.769813 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.770016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-13-iscsi {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.770242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.770456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.770663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.770876 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771532 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-13-iscsi {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.771987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.772361 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.772547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.772701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.772850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773669 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.773992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.774306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.774477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.774629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.774795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.774990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775460 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.775956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.776958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.777717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.777882 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.778035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.778190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.778341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.778492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-13-iscsi {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.778664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.779959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780739 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.780900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.781866 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.782022 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.782171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.782326 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.782477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.782630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783294 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783735 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.783957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784200 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784699 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784924 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.784995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785132 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785361 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785515 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785672 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785742 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.785983 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786134 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786204 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786679 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786756 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.786834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.787068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.787493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.787639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.787781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.787916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.788958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789225 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789628 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.789859 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.790035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.790264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.790472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.790630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.790786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.791065 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.791299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.791525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.791766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.791938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792092 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792534 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792827 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.792983 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793284 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793746 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.793889 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794180 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794489 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.794922 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795700 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.795861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796169 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796319 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796478 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796628 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.796948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.797100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.797286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.797433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.797581 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.797935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.798249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.798410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.798562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.798704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.798846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.799005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.799483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.799892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800347 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800661 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800824 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.800967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801268 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.801874 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802024 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802466 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802625 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.802927 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.803071 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.803222 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.803381 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.803540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.803944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.804255 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.804420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.804571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.804717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.804717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.805121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.805313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.805466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.805623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.805779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.805930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.806080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.806231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.806374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.806523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.806673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.806826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.806986 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.807129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.807341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.807503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.807678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.807849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.808192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.808510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.808666 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.808872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.809060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.809213 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.809377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.809806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.809806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.810319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.810470 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.810619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.810790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.811626 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.811853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 10:34:03.812019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.812953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.813883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814035 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814186 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814644 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.814961 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.815112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.815264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.815426 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.816980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.817124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.817699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.817863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.818035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.818362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.818362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.818798 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.818961 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819104 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.819930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.820365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.820521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.820826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.820985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821145 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821298 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821442 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821590 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.821929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.822100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.822427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.822675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.822857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823621 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.823825 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824319 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824470 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.824809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825382 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825677 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.825971 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826321 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.826926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.827850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.828014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.828167 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.828521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.828840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.828992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.829157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.829347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.829498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.829641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.830067 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.830234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.830405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.830664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.830831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831825 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.831970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832111 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832253 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832727 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.832870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833027 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833647 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.833940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834240 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834544 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834838 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.834978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835128 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835424 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835579 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.835935 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836088 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836237 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836378 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836527 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836668 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.836963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837735 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.837886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.838027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.838177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.838943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.839102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.839257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.839407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.839550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.839773 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.840202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.840202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.840520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.840683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.840935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841669 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.841963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842401 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.842865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843326 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843618 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843787 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.843934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.844087 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.844245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.845918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846662 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.846954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847423 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847573 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.847897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.848049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.848251 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.848408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.848550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.848726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.849344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.857875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.857993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.858994 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859070 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859208 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859712 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.859955 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860259 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860624 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860624 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860841 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.860923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861271 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.861938 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862076 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862160 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862319 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862612 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862917 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.862989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863067 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863384 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863470 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863633 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.863965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864713 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.864946 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865024 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865101 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865259 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865720 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.865950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866021 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866176 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.866950 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867251 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867326 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867612 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.867901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868564 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.868895 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.869055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.869168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.869900 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.869992 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870178 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870347 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870437 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870852 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.870940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871023 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871364 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871889 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.871984 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872105 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872740 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872829 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.872921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873515 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873770 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.873942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874240 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874876 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.874958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875557 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.875995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876167 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876339 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876434 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.876952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877544 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.877956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878457 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878889 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.878969 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879062 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879144 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.879944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880274 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880497 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880913 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.880998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881170 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881384 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881497 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881707 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.881925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882175 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882782 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.882865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883135 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883461 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883862 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.883965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.884092 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.884297 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.884395 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.884524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.884726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.885413 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.885616 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.885715 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.885715 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.885937 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886147 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886702 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.886863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887179 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887618 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.887956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888134 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888237 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.888865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889170 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.889991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890460 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890596 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.890892 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.891008 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.891189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.891325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.891551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.891641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892265 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.892856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893528 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.893844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894011 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894767 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.894926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895395 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895745 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.895851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.896829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897151 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897307 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897400 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.897791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898534 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898727 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.898892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899204 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899740 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.899847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900149 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900391 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.900831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.901018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.901305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.901486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.901774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.901883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.902934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.903882 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904436 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904823 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.904989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905125 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.905940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906038 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906259 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.906962 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907262 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907351 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.907905 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908812 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.908915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909271 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.909863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910475 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.910988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.911948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912087 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912430 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912748 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.912836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913165 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.913822 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914833 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.914940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.915138 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.915252 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.915453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.915559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.915792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.916270 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.916646 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.916744 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.916828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.916918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917131 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917787 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.917922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918116 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.918936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919144 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919247 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919566 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.919974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920417 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.920843 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921040 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921151 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.921974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922312 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922685 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.922861 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.923168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.923485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.923655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.923790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.923998 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.924994 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925858 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.925955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926173 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926513 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.926951 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.927163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.927261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.927472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.927569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.927805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.928023 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.928336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.928635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.928940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.929118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.929273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.929486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.929657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.929884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930294 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930470 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930694 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.930787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.931015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.931115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.931356 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.931465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.931821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932859 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.932952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933037 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933519 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933698 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933881 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.933971 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.934893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.935806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936127 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936338 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.936963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.937943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.938909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939233 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.939897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940109 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.940840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941142 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941354 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941452 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941662 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941760 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.941970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942591 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942900 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.942988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943209 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.943954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.944430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.944527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.944752 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.944845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945154 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.945990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946088 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.946914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.947025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.947330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.947850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.947850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948556 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.948911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949173 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949653 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.949949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.950940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951050 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951567 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.951929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952419 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.952867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953027 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.953874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.954851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955434 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.955786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956351 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.956766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.957136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.957456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.957790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.957924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.958886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.959119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.959267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.959410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.959530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.959840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960022 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960179 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.960765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.961554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.961713 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.961869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962455 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.962953 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963788 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.963911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964358 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964528 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.964879 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965801 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.965906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966138 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966242 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966512 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966722 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.966826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967021 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967417 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967617 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.967964 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.968982 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.969919 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970866 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.970958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971535 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.971976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972164 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972470 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.972884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973080 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973974 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.973974 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974376 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.974964 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.975182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.975275 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.975487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.975599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.975875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976466 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976562 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.976931 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.977134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.977236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.977775 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.977898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978752 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.978962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979058 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979740 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.979966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.980406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.980618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.980720 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.980925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981331 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981538 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981644 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.981942 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982146 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.982850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983155 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.983868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984101 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984203 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984342 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.984967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985279 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.985987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986497 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986587 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.986911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987127 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987219 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987532 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.987866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988088 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988567 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.988893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989508 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989732 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.989825 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990151 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.990978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.991965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992287 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992587 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.992987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993489 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.993943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994301 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994611 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.994881 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995401 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995535 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.995819 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996457 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996680 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.996985 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997602 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.997908 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998611 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998823 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.998915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999256 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999813 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:03.999913 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.000117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.000199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.001094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.001292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.001292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.001602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.001755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.002958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003274 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.003924 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004666 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.004967 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005884 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.005972 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.006963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007648 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.007954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.008191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.008279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 10:34:04.008498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 10:34:04.008797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 10:34:04.036554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.036959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_db.sqlalchemy.engines [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.214891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.context [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591e4b4b-d12e-4b86-9966-9fa5b93cdbbd(cell1) {{(pid=122858) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 10:34:04.216507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.context [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),591e4b4b-d12e-4b86-9966-9fa5b93cdbbd(cell1) {{(pid=122857) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 10:34:04.220303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:04.221568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:04.222084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:04.223144 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:04.223486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:04.224419 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:04.225579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:04.226840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:04.239560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.240593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.242986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_db.sqlalchemy.engines [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.248914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_db.sqlalchemy.engines [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.414930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_db.sqlalchemy.engines [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.418315 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_db.sqlalchemy.engines [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 10:34:04.744676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: WARNING keystonemiddleware.auth_token [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:34:04.747289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: WARNING keystonemiddleware.auth_token [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:34:04.751379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: WARNING keystonemiddleware.auth_token [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:34:04.753923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: WARNING keystonemiddleware.auth_token [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:34:05.102343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: WARNING keystonemiddleware.auth_token [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:34:05.106918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: WARNING keystonemiddleware.auth_token [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 10:34:05.108308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: WARNING keystonemiddleware.auth_token [None req-e6270273-5bd4-4630-bc27-f5cc38b3087b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:34:05.112353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: WARNING keystonemiddleware.auth_token [None req-bbcb725c-0488-4e12-8da0-362fb28c21fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 10:34:05.113978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3bf2149c0 pid: 122857 (default app) Nov 22 10:34:05.118317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e3bf2149c0 pid: 122858 (default app) Nov 22 10:34:40.338362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fe14a8e8-eb1c-4b68-a0d5-3f63aab82dfa tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Action: 'create', calling method: .version_select at 0x7f1a5b2bf4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1838048897", "metadata": {"Type": "work"}}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:40.826153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f870fcb8-c77c-40a7-b5c5-0ec325ea54c5 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Action: 'create', calling method: .version_select at 0x7f1a5b2be4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1879090323", "metadata": {"Type": "work"}}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:40.834107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f870fcb8-c77c-40a7-b5c5-0ec325ea54c5 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:40.835734 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f870fcb8-c77c-40a7-b5c5-0ec325ea54c5 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.631403 Nov 22 10:34:40.837900 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Nov 22 10:34:39 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1638 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:34:40.852837 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-59629608-88ec-47d6-abb1-59f5b3fc62b0 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Action: 'create', calling method: .version_select at 0x7f1a5b2c40d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-714556600", "metadata": {"Type": "work"}}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:40.854557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-59629608-88ec-47d6-abb1-59f5b3fc62b0 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:40.856140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-59629608-88ec-47d6-abb1-59f5b3fc62b0 tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013417 Nov 22 10:34:40.857870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 2/2] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Nov 22 10:34:40 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:34:40.866256 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-49b49e93-6c54-4b1c-9952-c989b952210d tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Action: 'create', calling method: .version_select at 0x7f1a5b2beca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1929686250", "metadata": {"Type": "work"}}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:40.871805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-49b49e93-6c54-4b1c-9952-c989b952210d tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:40.882406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-49b49e93-6c54-4b1c-9952-c989b952210d tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019760 Nov 22 10:34:40.887075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 3/3] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Nov 22 10:34:40 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 10:34:40.901582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c4300446-9e7b-4803-b92a-bd7f70a0268a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Calling method '.version_select at 0x7f1a5b2c90d0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:41.679610 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-c4300446-9e7b-4803-b92a-bd7f70a0268a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] HTTP exception thrown: Volume tempest-invalid-1685922865 could not be found. Nov 22 10:34:41.682563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c4300446-9e7b-4803-b92a-bd7f70a0268a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 404 to user: Volume tempest-invalid-1685922865 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:41.684816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c4300446-9e7b-4803-b92a-bd7f70a0268a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1685922865" status: 404 len: 99 microversion: 2.1 time: 0.788303 Nov 22 10:34:41.694634 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1217 bytes} [Mon Nov 22 10:34:40 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1685922865 => generated 99 bytes in 799 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 22 10:34:41.712821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-44b70f6f-3b54-4448-b18c-ed9097e58edc tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015133 Nov 22 10:34:41.720360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1139 bytes} [Mon Nov 22 10:34:41 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 10:34:41.732369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-53134994-9022-4f2f-a293-cd6e63bc8eef tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004697 Nov 22 10:34:41.735569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1136 bytes} [Mon Nov 22 10:34:41 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Nov 22 10:34:41.747738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5d16d866-6d87-43e7-a62b-80199c7bb92a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Calling method '.version_select at 0x7f1a5b18a5e0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:42.060858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-5d16d866-6d87-43e7-a62b-80199c7bb92a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] HTTP exception thrown: Volume fef85e3c-9058-4cfb-8695-73054e2804cc could not be found. Nov 22 10:34:42.061479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5d16d866-6d87-43e7-a62b-80199c7bb92a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 404 to user: Volume fef85e3c-9058-4cfb-8695-73054e2804cc could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:42.062259 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5d16d866-6d87-43e7-a62b-80199c7bb92a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/fef85e3c-9058-4cfb-8695-73054e2804cc" status: 404 len: 109 microversion: 2.1 time: 0.319556 Nov 22 10:34:42.062803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 7/7] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:34:41 2021] DELETE /compute/v2.1/os-volumes/fef85e3c-9058-4cfb-8695-73054e2804cc => generated 109 bytes in 321 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 10:34:42.073238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-379180cd-fd91-4e8e-84a3-cf40b4cf2e2a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Calling method '.version_select at 0x7f1a5b18a160>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:42.173006 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-379180cd-fd91-4e8e-84a3-cf40b4cf2e2a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] HTTP exception thrown: Volume d6d6a1ee-d078-447d-ab3f-a1e9993803b5 could not be found. Nov 22 10:34:42.173746 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-379180cd-fd91-4e8e-84a3-cf40b4cf2e2a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] Returning 404 to user: Volume d6d6a1ee-d078-447d-ab3f-a1e9993803b5 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:42.174737 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-379180cd-fd91-4e8e-84a3-cf40b4cf2e2a tempest-VolumesNegativeTest-1933148647 tempest-VolumesNegativeTest-1933148647-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d6d6a1ee-d078-447d-ab3f-a1e9993803b5" status: 404 len: 109 microversion: 2.1 time: 0.106091 Nov 22 10:34:42.175618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 8/8] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:42 2021] GET /compute/v2.1/os-volumes/d6d6a1ee-d078-447d-ab3f-a1e9993803b5 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:34:42.330227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fe14a8e8-eb1c-4b68-a0d5-3f63aab82dfa tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.390136 Nov 22 10:34:42.337738 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 1/9] 10.222.0.46 () {60 vars in 1155 bytes} [Mon Nov 22 10:34:38 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 10:34:42.343518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-85858260-02e6-4bfa-9e1e-bcf2fcf3e035 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b1aa670>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:42.489589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-85858260-02e6-4bfa-9e1e-bcf2fcf3e035 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 200 len: 353 microversion: 2.1 time: 0.150361 Nov 22 10:34:42.490253 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 9/10] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:42 2021] GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 353 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:34:43.502566 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-823cc503-7d22-47da-b02d-b5ef4b0d38c7 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b1aadc0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:43.531649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1052136092", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "1274854e-81ee-4efd-ac30-bca6abb4f0ab"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:43.652175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-823cc503-7d22-47da-b02d-b5ef4b0d38c7 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 200 len: 354 microversion: 2.1 time: 0.153347 Nov 22 10:34:43.653542 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 10/11] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:43 2021] GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:34:43.665708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b725ec10-9059-4773-959f-c0de58dc2ae8 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b1aa0d0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:43.724744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] validate_networks() for [('1274854e-81ee-4efd-ac30-bca6abb4f0ab', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:34:43.764706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b725ec10-9059-4773-959f-c0de58dc2ae8 tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 200 len: 354 microversion: 2.1 time: 0.103560 Nov 22 10:34:43.765559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 11/12] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:43 2021] GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:34:43.780119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b62763fb-8bcb-4dfa-8c57-ef769d14804c tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b18aaf0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:43.874822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b62763fb-8bcb-4dfa-8c57-ef769d14804c tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 202 len: 0 microversion: 2.1 time: 0.100529 Nov 22 10:34:43.879195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 12/13] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:34:43 2021] DELETE /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:34:43.884899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e499502a-db2f-426d-91ee-d64d59b71e2c tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b18a9d0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:43.946138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e499502a-db2f-426d-91ee-d64d59b71e2c tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 200 len: 353 microversion: 2.1 time: 0.065328 Nov 22 10:34:43.947493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 13/14] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:43 2021] GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:34:44.958895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-31001947-2bc0-4408-b7a2-49b51c261b8a tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Calling method '.version_select at 0x7f1a5b1aa280>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:45.056864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-31001947-2bc0-4408-b7a2-49b51c261b8a tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] HTTP exception thrown: Volume 3e62254d-758e-4899-b451-584bb9c3d5df could not be found. Nov 22 10:34:45.059527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-31001947-2bc0-4408-b7a2-49b51c261b8a tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] Returning 404 to user: Volume 3e62254d-758e-4899-b451-584bb9c3d5df could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:34:45.061847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-31001947-2bc0-4408-b7a2-49b51c261b8a tempest-VolumesGetTestJSON-1081421305 tempest-VolumesGetTestJSON-1081421305-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df" status: 404 len: 109 microversion: 2.1 time: 0.106105 Nov 22 10:34:45.063075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 14/15] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:44 2021] GET /compute/v2.1/os-volumes/3e62254d-758e-4899-b451-584bb9c3d5df => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:34:45.773674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:34:45.774477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:34:45.775173 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:34:45.775693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:34:45.776623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:34:45.831747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:45.834536 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:45.835642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:45.840453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:45.974243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Getting quotas for project df68136f15294909b23428e0edcd740d. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:34:45.995137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Getting quotas for user 2a927df2c1644bb4a08713d0d5d1f24a and project df68136f15294909b23428e0edcd740d. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:34:46.043138 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:34:46.046264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:34:46.289263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-495783e7-c540-4d2d-8f1c-da04f36e0718 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.284043 Nov 22 10:34:46.290450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 2/16] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:34:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 3287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:34:46.301964 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f531dc06-3840-4b3f-9f16-e33b38eee30c tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:46.302895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f531dc06-3840-4b3f-9f16-e33b38eee30c tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:46.673267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f531dc06-3840-4b3f-9f16-e33b38eee30c tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:46.732739 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f531dc06-3840-4b3f-9f16-e33b38eee30c tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1215 microversion: 2.1 time: 0.419401 Nov 22 10:34:46.736425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 15/17] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:46 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1215 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:47.756482 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a23dcb01-15bf-494c-bca6-ffbb4528755e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:47.757224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a23dcb01-15bf-494c-bca6-ffbb4528755e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:47.924113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a23dcb01-15bf-494c-bca6-ffbb4528755e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:47.978008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a23dcb01-15bf-494c-bca6-ffbb4528755e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1215 microversion: 2.1 time: 0.226758 Nov 22 10:34:47.998714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 3/18] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:47 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:49.012270 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:49.013162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:49.040916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:49.043487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:49.045121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:49.046916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:49.532325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:49.562059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-da040ab3-df4e-4e09-8a73-60c4918cd61e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1211 microversion: 2.1 time: 0.550325 Nov 22 10:34:49.566089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 16/19] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:49 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1211 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:50.580883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:50.581624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:50.594028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:50.594473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:50.595302 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:50.595759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:50.791336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:50.799726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1c63f822-507f-42e1-ace4-dcf958962b0d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1273 microversion: 2.1 time: 0.223179 Nov 22 10:34:50.800341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 17/20] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:50 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1273 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:34:50.915301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: .version_select at 0x7f1a5a04fa60>, body: {"keypair": {"name": "tempest-keypair-1132484250"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:50.969387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:34:50.983112 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:34:51.424454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:34:51.431181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:34:51.457871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5c957c85-5f45-4e4f-8ec5-7b4674a6819e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.105059 Nov 22 10:34:51.459172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 4/21] 10.222.0.46 () {62 vars in 1198 bytes} [Mon Nov 22 10:34:50 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1112 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:34:51.818348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:51.819856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:51.831324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:51.836823 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:51.841167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:51.841674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:52.179340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:52.200159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-45ef2e06-4e4f-4602-ba8e-454ad1ca605f tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1273 microversion: 2.1 time: 0.385807 Nov 22 10:34:52.206961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 18/22] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:51 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1273 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:53.222773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:53.224075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:53.249445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:53.250258 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:53.258290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:53.277514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:54.180538 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:54.292667 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-40500a56-9fe5-49c5-9f7a-ef548d7fda8b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1273 microversion: 2.1 time: 1.078129 Nov 22 10:34:54.310526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 5/23] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:53 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1273 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:34:55.317033 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:55.317627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:55.329031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:55.329514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:55.330287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:55.330722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:55.539364 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:55.552966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3f02ba86-599d-44f9-bd58-60eff8cf5cda tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1273 microversion: 2.1 time: 0.239978 Nov 22 10:34:55.553603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 19/24] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:55 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:55.625135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c8e8bed8-3889-4707-a3f3-250b9fcd1600 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5979aca0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:55.811171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c8e8bed8-3889-4707-a3f3-250b9fcd1600 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/08a78767-da55-48ca-a6a9-373c591538f9" status: 200 len: 350 microversion: 2.1 time: 0.189749 Nov 22 10:34:55.812701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 6/25] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:55 2021] GET /compute/v2.1/os-volumes/08a78767-da55-48ca-a6a9-373c591538f9 => generated 350 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:34:56.583543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:56.586235 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:34:56.607042 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-682877374", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "153a66f8-3695-4a0f-8479-33d7bddbc164"}]}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:34:56.643267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:56.644706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:56.657757 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:34:56.661207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:34:56.815740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] validate_networks() for [('153a66f8-3695-4a0f-8479-33d7bddbc164', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:34:59.220133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:34:59.251346 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-847b7a45-57e0-43d8-b265-05ad73481d7d tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 2.675486 Nov 22 10:34:59.257261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 7/26] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:34:56 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:34:59.269911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2a72b51e-6e92-49a4-b586-0d80901782a9 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a597aa430>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:34:59.396874 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2a72b51e-6e92-49a4-b586-0d80901782a9 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5ae08e17-66b7-4f31-80fa-5293d73d57ba" status: 200 len: 350 microversion: 2.1 time: 0.137134 Nov 22 10:34:59.397754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 8/27] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:34:59 2021] GET /compute/v2.1/os-volumes/5ae08e17-66b7-4f31-80fa-5293d73d57ba => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:00.274223 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:00.274953 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:00.287790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:00.288193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:00.297505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:00.299026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:01.999756 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:02.014521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5f4eb7a6-6768-4686-bad7-c9f86b2fdd67 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 1.744011 Nov 22 10:35:02.018701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 9/28] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:00 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:02.027264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9b1fd2dc-ade5-48b4-9739-13c2a25df2fd tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a597aad30>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:02.190898 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9b1fd2dc-ade5-48b4-9739-13c2a25df2fd tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/e2b3cedc-eda9-4af8-b361-d79e575be36b" status: 200 len: 351 microversion: 2.1 time: 0.170725 Nov 22 10:35:02.192007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 10/29] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:35:02 2021] GET /compute/v2.1/os-volumes/e2b3cedc-eda9-4af8-b361-d79e575be36b => generated 351 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:02.204021 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e046f672-fc62-4586-943a-14c8f00c8e2a tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a597ebdc0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:02.513411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e046f672-fc62-4586-943a-14c8f00c8e2a tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.313350 Nov 22 10:35:02.515449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 11/30] 10.222.0.46 () {58 vars in 1133 bytes} [Mon Nov 22 10:35:02 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:02.966449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:02.967940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:02.968580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:02.969137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:02.969709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:03.003650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:03.005412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:03.006530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:03.008820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:03.093502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Getting quotas for project 47dcd8cc91c540eda175b762b2cc6d9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:03.109817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Getting quotas for user 3b0cecac44354a5aa1e9e517f7f6e813 and project 47dcd8cc91c540eda175b762b2cc6d9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:03.139210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:03.147580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:03.237578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: .version_select at 0x7f1a59748820>, body: {"keypair": {"name": "tempest-keypair-668343336"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:03.317187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:03.330733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:03.436295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c6fc6e35-e3b7-404a-8937-f4bf554c4e47 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.745958 Nov 22 10:35:03.441117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 20/31] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:34:55 2021] POST /compute/v2.1/servers => generated 383 bytes in 7753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:35:03.458490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-179f4a5e-30ef-47e5-b234-2214f2d27f61 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5b05a160>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:03.799722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-179f4a5e-30ef-47e5-b234-2214f2d27f61 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.355878 Nov 22 10:35:03.801725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 21/32] 10.222.0.46 () {58 vars in 1148 bytes} [Mon Nov 22 10:35:03 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:03.814320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:03.815349 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:03.845491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:03.845491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:03.845491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:03.845491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:04.612176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:04.627054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:04.685051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0c814609-b3ee-4cf1-84c8-9a3b4da5bd31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 2.168211 Nov 22 10:35:04.687837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 12/33] 10.222.0.46 () {60 vars in 1157 bytes} [Mon Nov 22 10:35:02 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:04.692864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e13f5910-4430-46e3-84a4-3ebf440c6c7e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:04.702611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e13f5910-4430-46e3-84a4-3ebf440c6c7e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:05.273651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e13f5910-4430-46e3-84a4-3ebf440c6c7e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:05.296980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e13f5910-4430-46e3-84a4-3ebf440c6c7e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1221 microversion: 2.1 time: 0.607577 Nov 22 10:35:05.306282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 13/34] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:04 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1221 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:05.328014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c5b32b4a-a907-47b8-80b9-ab5c19fac9ce tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a597863a0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:05.594926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c5b32b4a-a907-47b8-80b9-ab5c19fac9ce tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.287165 Nov 22 10:35:05.595767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 14/35] 10.222.0.46 () {58 vars in 1133 bytes} [Mon Nov 22 10:35:05 2021] GET /compute/v2.1/os-volumes => generated 1034 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:05.706148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:05.754614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a58c1494-ba17-4265-ad9c-a471aaf33815 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 1.946393 Nov 22 10:35:05.759009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 22/36] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:03 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:05.773592 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-043d3e0e-56dc-4328-a04f-6da750e053c6 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5a79b700>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:05.973950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-a5f9b3e5-0546-48b7-9c34-7f118d7eb283 req-e5d7e7a3-9b18-493c-9fb6-c79242f24474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fa7b826-3fcb-47c6-8301-f88892120095", "tag": "a26d823d-0945-45d5-b889-984e5d69086e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:05.977481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:05.977481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:35:06.012385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-a5f9b3e5-0546-48b7-9c34-7f118d7eb283 req-e5d7e7a3-9b18-493c-9fb6-c79242f24474 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:06.021568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-a5f9b3e5-0546-48b7-9c34-7f118d7eb283 req-e5d7e7a3-9b18-493c-9fb6-c79242f24474 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:06.104826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-a5f9b3e5-0546-48b7-9c34-7f118d7eb283 req-e5d7e7a3-9b18-493c-9fb6-c79242f24474 service nova] Creating event network-changed:a26d823d-0945-45d5-b889-984e5d69086e for instance 0fa7b826-3fcb-47c6-8301-f88892120095 on hv-cinder-80403 Nov 22 10:35:06.105792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-a5f9b3e5-0546-48b7-9c34-7f118d7eb283 req-e5d7e7a3-9b18-493c-9fb6-c79242f24474 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 10:35:06.107218 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:06.108152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:06.109418 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:06.110232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:06.129686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.compute.rpcapi [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 10:35:06.132778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] Releasing lock "compute-rpcapi-router" {{(pid=122857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 10:35:06.152405 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-043d3e0e-56dc-4328-a04f-6da750e053c6 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.388947 Nov 22 10:35:06.169175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 23/37] 10.222.0.46 () {58 vars in 1166 bytes} [Mon Nov 22 10:35:05 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:06.174565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-709184021", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "153a66f8-3695-4a0f-8479-33d7bddbc164"}]}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:06.236293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b9e1a8ee-d15d-49f1-93bb-a4af131c6c96 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.638380 Nov 22 10:35:06.238047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 15/38] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:06.249850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8e524954-3266-4387-b6c7-86c761324c1a tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a597480d0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:06.342016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] validate_networks() for [('153a66f8-3695-4a0f-8479-33d7bddbc164', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:35:06.627773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8e524954-3266-4387-b6c7-86c761324c1a tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.387521 Nov 22 10:35:06.628912 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 16/39] 10.222.0.46 () {58 vars in 1169 bytes} [Mon Nov 22 10:35:06 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:06.648256 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1985532307", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e114790e-2c2f-46a4-8dd6-49197de38f16"}], "security_groups": [{"name": "tempest-securitygroup--1486274065"}], "key_name": "tempest-keypair-1132484250", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:07.655355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] validate_networks() for [('e114790e-2c2f-46a4-8dd6-49197de38f16', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:35:08.693882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:08.696083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:08.696848 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:08.697650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:08.698570 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:08.714658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:08.718953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:08.720627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:08.721850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:08.752083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Getting quotas for project 47dcd8cc91c540eda175b762b2cc6d9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:08.757243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Getting quotas for user 3b0cecac44354a5aa1e9e517f7f6e813 and project 47dcd8cc91c540eda175b762b2cc6d9d. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:08.772191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:08.774800 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:08.836077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-269554cd-6bb2-4377-951a-2a557fbf5a9c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.665331 Nov 22 10:35:08.837484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 24/40] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:35:06 2021] POST /compute/v2.1/servers => generated 383 bytes in 2667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:35:08.846338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-827eadbc-283b-48a1-934d-0b3d20305773 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5a7aaee0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:08.957700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-827eadbc-283b-48a1-934d-0b3d20305773 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.118843 Nov 22 10:35:08.958295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 25/41] 10.222.0.46 () {58 vars in 1154 bytes} [Mon Nov 22 10:35:08 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:08.971402 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:08.972129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:08.980264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:08.980732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:08.981559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:08.982194 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:09.917593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:09.918935 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:09.919911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:09.920686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:09.921302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:09.933096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:09.933964 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:09.934792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:09.935224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:09.992440 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:09.999481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:10.024703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:10.028274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:10.093182 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:10.109406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b1b539cf-b225-4039-8599-c6595e13eb77 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.477466 Nov 22 10:35:10.110920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7d6d5a86-cea6-4ef4-827a-5d38a630eefc tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 1.142450 Nov 22 10:35:10.112220 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 17/42] 10.222.0.46 () {62 vars in 1187 bytes} [Mon Nov 22 10:35:06 2021] POST /compute/v2.1/servers => generated 402 bytes in 3483 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 10:35:10.113526 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 26/43] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:08 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:10.129091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-38185788-c62c-4c98-9158-a584f149b3be tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5b039820>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:10.130611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:10.131558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:10.150736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:10.151492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:10.152931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:10.153836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:10.282806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-38185788-c62c-4c98-9158-a584f149b3be tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.167092 Nov 22 10:35:10.283470 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 27/44] 10.222.0.46 () {58 vars in 1187 bytes} [Mon Nov 22 10:35:10 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:10.288048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:10.289952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:10.328282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:10.336454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-09429e77-f6e1-436f-86e7-68aee7bf806f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1281 microversion: 2.1 time: 0.222720 Nov 22 10:35:10.348327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 18/45] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:10 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1281 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:10.354009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-93a57f86-59a6-4c18-9338-7153b9dbb524 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] Calling method '.version_select at 0x7f1a5979ad30>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:10.451452 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:10.462644 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:10.480684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:10.482278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a5f8fa5b-0c86-4463-a558-01b44fd75627 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1282 microversion: 2.20 time: 0.197687 Nov 22 10:35:10.486098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 28/46] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:10 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:10.510628 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-93a57f86-59a6-4c18-9338-7153b9dbb524 tempest-VolumesTestJSON-1756635913 tempest-VolumesTestJSON-1756635913-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.161066 Nov 22 10:35:10.511427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 19/47] 10.222.0.46 () {58 vars in 1154 bytes} [Mon Nov 22 10:35:10 2021] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:10.792080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-945932217", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8081780-6619-4e5e-aa59-236a3848a084"}], "security_groups": [{"name": "tempest-securitygroup--584654050"}], "key_name": "tempest-keypair-668343336", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:11.129859 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:11.131159 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:11.147687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:11.148446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:11.149782 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:11.150361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:11.226627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] validate_networks() for [('f8081780-6619-4e5e-aa59-236a3848a084', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:35:11.875497 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:11.887116 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-095f50a6-bfc0-4b6b-95c3-15df7e78fec0 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 0.761832 Nov 22 10:35:11.887785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 20/48] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:11 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:11.915927 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:11.916550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:11.937655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:11.938125 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:11.938982 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:11.939427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:12.210172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:12.225026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c1b36836-e3d2-4c4f-9482-fc8c15a0537e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1279 microversion: 2.1 time: 0.322689 Nov 22 10:35:12.225622 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 21/49] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:11 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:12.235550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:12.236641 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:12.258414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:12.259274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:12.260204 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:12.260821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:12.393280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:12.407399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:12.409292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:12.410901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-79dddbca-4b66-4abc-a4d4-4e5d8cd8c167 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1340 microversion: 2.20 time: 0.184118 Nov 22 10:35:12.425668 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 22/50] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:12 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1340 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:12.906825 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:12.908973 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:12.943126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:12.943785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:12.945868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:12.949840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.037909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:13.038481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:13.039786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:13.041209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:13.042449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:13.056898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.058073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.059275 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.059997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.093864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:13.099502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:13.119738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:13.124235 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:13.264864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-eb18a364-7002-4644-a986-4ef279af1d02 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.482151 Nov 22 10:35:13.267359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 29/51] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:35:10 2021] POST /compute/v2.1/servers => generated 401 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:35:13.275653 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:13.278676 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:13.293379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.294234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.296305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.297695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.655433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:13.663590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4894ea2e-d246-4f1e-977d-f2ee58887a97 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 0.762357 Nov 22 10:35:13.673817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 23/52] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:12 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:13.678753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-58c95c42-dad6-440b-bcf5-22eb24c8b530 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:13.679548 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-58c95c42-dad6-440b-bcf5-22eb24c8b530 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:13.840890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-58c95c42-dad6-440b-bcf5-22eb24c8b530 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:13.850758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-58c95c42-dad6-440b-bcf5-22eb24c8b530 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1236 microversion: 2.1 time: 0.174751 Nov 22 10:35:13.851356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 24/53] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:13 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1236 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:13.858425 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:13.859359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:13.884317 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.885093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.887752 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:13.888955 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:13.961244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:13.969675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fa7ecee8-cce8-4eb8-b34e-f33caa753db3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.699610 Nov 22 10:35:13.972335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 30/54] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:13 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:14.055254 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:14.073324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:14.076976 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:14.080474 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fed15cf0-9113-4807-98d3-382b965f75d6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1340 microversion: 2.20 time: 0.226749 Nov 22 10:35:14.082602 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 25/55] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:13 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1340 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:14.541192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-f05d9678-9ebe-4070-ad2e-58ecbeea55d2 req-e9b29ffb-eaa9-478b-a9f1-2c8de622a7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60ede0be-83f5-416b-8ba7-216691a79cbc", "tag": "e7b68ff2-ecd7-4e74-81b4-cf38071ef393"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:14.543679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:14.543679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:14.564084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-f05d9678-9ebe-4070-ad2e-58ecbeea55d2 req-e9b29ffb-eaa9-478b-a9f1-2c8de622a7ed service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.564524 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-f05d9678-9ebe-4070-ad2e-58ecbeea55d2 req-e9b29ffb-eaa9-478b-a9f1-2c8de622a7ed service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.606147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-f05d9678-9ebe-4070-ad2e-58ecbeea55d2 req-e9b29ffb-eaa9-478b-a9f1-2c8de622a7ed service nova] Creating event network-changed:e7b68ff2-ecd7-4e74-81b4-cf38071ef393 for instance 60ede0be-83f5-416b-8ba7-216691a79cbc on hv-cinder-80403 Nov 22 10:35:14.606805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-f05d9678-9ebe-4070-ad2e-58ecbeea55d2 req-e9b29ffb-eaa9-478b-a9f1-2c8de622a7ed service nova] Acquired lock "compute-rpcapi-router" {{(pid=122858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 10:35:14.623054 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.623736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.624823 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.625478 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.635476 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.compute.rpcapi [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 10:35:14.646480 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] Releasing lock "compute-rpcapi-router" {{(pid=122858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 10:35:14.687691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:14.688306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:14.701133 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9c559696-4658-4c0e-b47f-b7dcbbeefb02 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164311 Nov 22 10:35:14.702196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 31/56] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:14.710306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.711413 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.714043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.714493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.869768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:14.870493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:14.885208 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.885625 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:14.886569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:14.887012 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:15.244152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:15.268173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-321efef3-d298-4c1d-a454-60d49e10b5e7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1296 microversion: 2.1 time: 0.400582 Nov 22 10:35:15.270416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 32/57] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:14 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1296 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:15.281681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:15.284153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:15.301167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:15.302053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:15.302886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:15.303323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:15.862348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:15.884681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-35cf5aac-82e5-4493-b8bc-1fddc06b0dc2 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 1.205224 Nov 22 10:35:15.894643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 26/58] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:14 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:15.894643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:15.897143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:15.910713 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:15.911939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:15.913522 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:15.914113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:15.982899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:15.999594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7790bbe9-a7c2-46ab-9c23-7f32ba6fe24d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.725907 Nov 22 10:35:16.000662 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 33/59] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:15 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:16.317009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-bde21924-c1dc-4956-a098-809f6a4677e6 req-6094f240-9f55-4108-8236-60f49b88ef8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa7b826-3fcb-47c6-8301-f88892120095", "name": "network-vif-plugged", "status": "completed", "tag": "a26d823d-0945-45d5-b889-984e5d69086e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:16.318898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:16.318898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:16.331520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-bde21924-c1dc-4956-a098-809f6a4677e6 req-6094f240-9f55-4108-8236-60f49b88ef8b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.335646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-bde21924-c1dc-4956-a098-809f6a4677e6 req-6094f240-9f55-4108-8236-60f49b88ef8b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:16.354485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-bde21924-c1dc-4956-a098-809f6a4677e6 req-6094f240-9f55-4108-8236-60f49b88ef8b service nova] Creating event network-vif-plugged:a26d823d-0945-45d5-b889-984e5d69086e for instance 0fa7b826-3fcb-47c6-8301-f88892120095 on hv-cinder-80403 Nov 22 10:35:16.361448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-bde21924-c1dc-4956-a098-809f6a4677e6 req-6094f240-9f55-4108-8236-60f49b88ef8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357453 Nov 22 10:35:16.362465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 34/60] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:16.379799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:16.380871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:16.391377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.393089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:16.394146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.394985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:16.556834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:16.569452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:16.574238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6b3e2df9-fd69-422b-b132-922ae8e10b37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1294 microversion: 2.1 time: 0.199121 Nov 22 10:35:16.575462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 35/61] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:16 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1294 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:16.592618 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:16.596991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:16.602003 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1e4f9af9-780d-41f0-9eae-3b70eec3c992 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.714229 Nov 22 10:35:16.621996 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 27/62] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:15 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:16.791944 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-ac125303-d3f3-4175-8d80-7a5f4bd64da3 req-f2c646ad-7af5-4aad-a0ed-b7505070e554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff495625-b409-4b63-93e2-68dbf32cd7c5", "tag": "20f53f90-3a43-45e0-ab9e-ae35149604a8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:16.793538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:16.793538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:16.816652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ac125303-d3f3-4175-8d80-7a5f4bd64da3 req-f2c646ad-7af5-4aad-a0ed-b7505070e554 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.819578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ac125303-d3f3-4175-8d80-7a5f4bd64da3 req-f2c646ad-7af5-4aad-a0ed-b7505070e554 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:16.855142 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-ac125303-d3f3-4175-8d80-7a5f4bd64da3 req-f2c646ad-7af5-4aad-a0ed-b7505070e554 service nova] Creating event network-changed:20f53f90-3a43-45e0-ab9e-ae35149604a8 for instance ff495625-b409-4b63-93e2-68dbf32cd7c5 on hv-cinder-80403 Nov 22 10:35:16.867220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-ac125303-d3f3-4175-8d80-7a5f4bd64da3 req-f2c646ad-7af5-4aad-a0ed-b7505070e554 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081408 Nov 22 10:35:16.870119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 36/63] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:16.903753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:16.904379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:16.926110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.927567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:16.928554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:16.929005 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:17.039689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:17.040696 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:17.064701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:17.069344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:17.072614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:17.075262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:17.961857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:17.989596 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-629e1d82-4c0c-4452-a6c5-08889b24fd60 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 1.085310 Nov 22 10:35:17.990331 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 28/64] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:16 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:18.018376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:18.022776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:18.038185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:18.039336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:18.042784 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:18.044743 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:18.502520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:18.537762 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-15733772-4b28-4699-9f02-2a44f45e94f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 1.505106 Nov 22 10:35:18.542089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 37/65] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:17 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:18.570881 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:18.588676 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:18.619878 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:18.624811 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:18.629372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:18.633254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:19.962232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:19.976523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b808b820-d82b-42f1-98ed-423ce4cba27e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 1.982082 Nov 22 10:35:19.977514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 29/66] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:17 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:19.995369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:19.997993 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:20.017563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:20.019143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:20.021839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:20.022910 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:20.179847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:20.191294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:20.194028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:20.195700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0d9a9eaa-e452-4287-9767-4cb0c024e7e3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 1.649440 Nov 22 10:35:20.196544 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 38/67] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:18 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:20.212817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-870ed01b-e16d-4ca8-8888-ce5ee7ed0097 req-a8bfa3d3-23e1-4827-a6bd-f16d78e7153f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:20.215084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:20.215084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:20.225087 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-870ed01b-e16d-4ca8-8888-ce5ee7ed0097 req-a8bfa3d3-23e1-4827-a6bd-f16d78e7153f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:20.225739 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-870ed01b-e16d-4ca8-8888-ce5ee7ed0097 req-a8bfa3d3-23e1-4827-a6bd-f16d78e7153f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:20.244695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-870ed01b-e16d-4ca8-8888-ce5ee7ed0097 req-a8bfa3d3-23e1-4827-a6bd-f16d78e7153f service nova] Creating event network-changed:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:35:20.255386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-870ed01b-e16d-4ca8-8888-ce5ee7ed0097 req-a8bfa3d3-23e1-4827-a6bd-f16d78e7153f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044547 Nov 22 10:35:20.257743 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 39/68] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:20.267916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:20.269522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:20.280107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:20.280548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:20.281625 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:20.282471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:20.965464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:20.977968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a41e6e31-ebfc-4ed1-baf9-8542358fc362 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1315 microversion: 2.1 time: 0.996346 Nov 22 10:35:20.991060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 30/69] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:19 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:21.071282 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:21.087362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6d7e8e37-b16f-4d22-868f-e926a2f63cb4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.827514 Nov 22 10:35:21.090779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 40/70] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:20 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:21.105366 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:21.107641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:21.125294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:21.126719 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:21.129498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:21.131073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:21.453483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-2fd504fc-8265-42aa-ba7c-13076e2c4916 req-1754c049-3d19-4854-bc17-181f76430117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516b0499-a733-410c-9a0c-6e98ff43aba0", "tag": "16c7e493-84ec-4f05-8c01-8c85e582654e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:21.455896 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:21.455896 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:35:21.464644 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-2fd504fc-8265-42aa-ba7c-13076e2c4916 req-1754c049-3d19-4854-bc17-181f76430117 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:21.465089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-2fd504fc-8265-42aa-ba7c-13076e2c4916 req-1754c049-3d19-4854-bc17-181f76430117 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:21.477226 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-2fd504fc-8265-42aa-ba7c-13076e2c4916 req-1754c049-3d19-4854-bc17-181f76430117 service nova] Creating event network-changed:16c7e493-84ec-4f05-8c01-8c85e582654e for instance 516b0499-a733-410c-9a0c-6e98ff43aba0 on hv-cinder-80403 Nov 22 10:35:21.483579 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-2fd504fc-8265-42aa-ba7c-13076e2c4916 req-1754c049-3d19-4854-bc17-181f76430117 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490669 Nov 22 10:35:21.484897 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 31/71] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:21.498923 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:21.500027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:21.508379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:21.509177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:21.510179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:21.511168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:21.630755 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:21.638925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0d15c9d5-81b6-400d-bb5e-1956955f1c57 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.546516 Nov 22 10:35:21.639937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 41/72] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:21 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:21.970070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:21.981272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:21.982785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:21.984554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0d611149-5d13-4784-a8cd-25eac19917fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.498210 Nov 22 10:35:21.985206 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 32/73] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:21 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:22.001602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:22.002230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:22.008795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.009301 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.010388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.011187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.107016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:22.107871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:22.122090 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.122564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.123368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.123864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.519099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:22.538047 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3718512c-ecef-4769-884e-e2fc23ef2788 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1502 microversion: 2.1 time: 0.544836 Nov 22 10:35:22.553820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 42/74] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:21 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1502 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:22.659074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:22.659977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:22.683014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.683471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.690349 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:22.690843 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:22.730579 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:22.743440 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b0d5292e-9f94-4761-afb1-65ca81d3701a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.640659 Nov 22 10:35:22.746915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 33/75] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:22 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:23.004645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:23.005283 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:23.019726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:23.021121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:23.023728 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:23.024076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:23.242010 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:23.253321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-648b7c21-6db4-40dc-963f-0f656889a1f1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.601270 Nov 22 10:35:23.254151 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 43/76] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:22 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:23.270637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-6841bc2f-35aa-4081-ac83-f07633f7af13 req-448dca61-a500-4c85-8166-3cd4897b6888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ede0be-83f5-416b-8ba7-216691a79cbc", "name": "network-vif-plugged", "status": "completed", "tag": "e7b68ff2-ecd7-4e74-81b4-cf38071ef393"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:23.275780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:23.275780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:23.296521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6841bc2f-35aa-4081-ac83-f07633f7af13 req-448dca61-a500-4c85-8166-3cd4897b6888 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:23.298853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6841bc2f-35aa-4081-ac83-f07633f7af13 req-448dca61-a500-4c85-8166-3cd4897b6888 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:23.323397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-6841bc2f-35aa-4081-ac83-f07633f7af13 req-448dca61-a500-4c85-8166-3cd4897b6888 service nova] Creating event network-vif-plugged:e7b68ff2-ecd7-4e74-81b4-cf38071ef393 for instance 60ede0be-83f5-416b-8ba7-216691a79cbc on hv-cinder-80403 Nov 22 10:35:23.338803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-6841bc2f-35aa-4081-ac83-f07633f7af13 req-448dca61-a500-4c85-8166-3cd4897b6888 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083237 Nov 22 10:35:23.343310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 44/77] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:23.437429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:23.446903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:23.453775 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:23.454947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-65efd156-666a-4912-94a4-4970b0b7422b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.455626 Nov 22 10:35:23.455507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 34/78] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:22 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:23.772061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:23.773023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:23.780327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:23.780776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:23.781595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:23.781993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.270739 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4f11c20-cd4c-4d73-9b4c-aef281527297"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:24.272403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:24.281064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.281570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.282462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.283075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.286519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:24.294324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-10327edb-3fae-4e83-adc8-cca4cec73cd1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.527328 Nov 22 10:35:24.295429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 45/79] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:23 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:24.320036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:24.321867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:24.335979 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.336678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.337850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.338482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.580958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:24.593718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a1ff1bd9-21c2-48ff-98c3-1ec8ebce6cd8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.289136 Nov 22 10:35:24.596094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 46/80] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:24 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:24.609807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:24.612659 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:24.625892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.627111 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.628032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:24.628540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:24.883203 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cbe1435c-8a24-4a4d-9fd3-56d346b26ba7 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "POST /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.615944 Nov 22 10:35:24.893976 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 35/81] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:35:24 2021] POST /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:35:25.055574 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:25.069465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:25.074923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:25.077685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bd40e008-5c0f-49a4-b742-5fc935fc96e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.480422 Nov 22 10:35:25.079171 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 47/82] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:24 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:25.314929 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:25.316091 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:25.325200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:25.325651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:25.326438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:25.326865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:25.387108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-88744227-35f2-4939-b3c7-9417deabd2c5 req-e235774f-b2f3-49f8-846c-ca426023b681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff495625-b409-4b63-93e2-68dbf32cd7c5", "name": "network-vif-plugged", "status": "completed", "tag": "20f53f90-3a43-45e0-ab9e-ae35149604a8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:25.389655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:25.389655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:25.398468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-88744227-35f2-4939-b3c7-9417deabd2c5 req-e235774f-b2f3-49f8-846c-ca426023b681 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:25.399150 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-88744227-35f2-4939-b3c7-9417deabd2c5 req-e235774f-b2f3-49f8-846c-ca426023b681 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:25.418403 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-88744227-35f2-4939-b3c7-9417deabd2c5 req-e235774f-b2f3-49f8-846c-ca426023b681 service nova] Creating event network-vif-plugged:20f53f90-3a43-45e0-ab9e-ae35149604a8 for instance ff495625-b409-4b63-93e2-68dbf32cd7c5 on hv-cinder-80403 Nov 22 10:35:25.428729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-88744227-35f2-4939-b3c7-9417deabd2c5 req-e235774f-b2f3-49f8-846c-ca426023b681 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046435 Nov 22 10:35:25.430187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 48/83] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:25.613234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:25.614212 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:25.620929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:25.621660 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:25.622952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:25.623543 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:25.626967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:25.640999 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-21de30b3-6bb6-44a0-a909-e3c181ebcb44 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.328094 Nov 22 10:35:25.643991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 36/84] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:25 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:25.882375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:25.893547 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-da530dd0-953e-4a7f-91a0-7741712e58c2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.284760 Nov 22 10:35:25.906413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 49/85] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:25 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:26.097487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:26.098360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:26.112258 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.116579 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.119943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.124118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.503857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:26.523710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:26.526101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:26.529068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-98e79648-f244-43e5-9294-3114dc36c5be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.435836 Nov 22 10:35:26.531737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 37/86] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:26 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:26.671608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:26.671608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:26.683181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.687245 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.688159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.688616 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.912815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:26.913460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:26.919608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.920442 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.921377 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:26.922092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:26.940981 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:26.958363 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4e72fe78-d160-4cec-8f18-565fbb377f43 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1321 microversion: 2.1 time: 0.302036 Nov 22 10:35:26.967721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 50/87] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:26 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:27.103634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:27.115441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4e1694c7-6a8b-4908-a7e8-9c3a77869c6f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.207598 Nov 22 10:35:27.117605 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 38/88] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:26 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:27.550311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:27.551325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:27.557722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:27.558164 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:27.559128 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:27.559715 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:27.717601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:27.728206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:27.730187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:27.731830 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-48480340-b5c3-4b34-99cb-9e30bac045ea tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.185396 Nov 22 10:35:27.733173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 51/89] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:27 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:27.978855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:27.980294 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:27.998298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:27.998938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.000435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.001022 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.139621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:28.140426 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:28.151654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.152373 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.153725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.154402 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.221811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:28.232175 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-452d5f45-c36c-4723-85b6-605be44c3b70 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1515 microversion: 2.1 time: 0.258401 Nov 22 10:35:28.233606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 39/90] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:27 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:28.251194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:28.252435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:28.259310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.260084 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.261095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.261681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.294372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lazy-loading 'flavor' on Instance uuid ff495625-b409-4b63-93e2-68dbf32cd7c5 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:35:28.389352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:28.397951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3f94f7ca-cc51-4c48-8c5c-e07be49e28be tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.268019 Nov 22 10:35:28.399699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 52/91] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:28 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:28.450479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-40e9de7e-f48b-44d6-a935-7540ec686191 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5/action" status: 200 len: 32 microversion: 2.1 time: 0.203161 Nov 22 10:35:28.451107 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 40/92] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:28 2021] POST /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:35:28.461775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:28.462094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:28.472298 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.473965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.476793 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.478605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.724155 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:28.732219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-38b96c01-99f6-4164-ba48-fe2aa0ec8ac9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.275567 Nov 22 10:35:28.732816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 53/93] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:28 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:28.751924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:28.752634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:28.763255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.764009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.765235 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.765915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.777558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-f5c24977-2dd6-4907-989f-8f21662a3360 req-a620dc8c-f2b9-423e-847e-a53cfb0b715d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "name": "network-vif-plugged", "status": "completed", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:28.779597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:28.779597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:28.795074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-f5c24977-2dd6-4907-989f-8f21662a3360 req-a620dc8c-f2b9-423e-847e-a53cfb0b715d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:28.795517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-f5c24977-2dd6-4907-989f-8f21662a3360 req-a620dc8c-f2b9-423e-847e-a53cfb0b715d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:28.824223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-f5c24977-2dd6-4907-989f-8f21662a3360 req-a620dc8c-f2b9-423e-847e-a53cfb0b715d service nova] Creating event network-vif-plugged:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:35:28.830533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-f5c24977-2dd6-4907-989f-8f21662a3360 req-a620dc8c-f2b9-423e-847e-a53cfb0b715d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061277 Nov 22 10:35:28.831715 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 54/94] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:29.231388 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:29.242633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:29.244162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:29.245313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ed4df0e7-4022-4ae9-a065-66f4809ef06c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.498107 Nov 22 10:35:29.246259 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 41/95] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:28 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:29.417434 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:29.418770 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:29.425726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:29.426173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:29.426993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:29.427427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:29.603804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:29.611962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b0db38bd-ec07-42f2-8232-bda9c645b47b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.199085 Nov 22 10:35:29.621920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 55/96] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:29 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:29.761844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:29.762586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:29.786941 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:29.788452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:29.790450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:29.791131 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.011414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:30.018967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-16e8b823-7d5b-46ac-9665-45b38d155423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.270474 Nov 22 10:35:30.019559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 42/97] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:29 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:30.262956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:30.263556 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:30.269589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:30.270043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.270852 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:30.271279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.422693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:30.454338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:30.456181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:30.458411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3a9d2160-c3eb-4895-b788-01bc7aec4440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1408 microversion: 2.20 time: 0.199417 Nov 22 10:35:30.459772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 56/98] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:30 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:30.629323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:30.629934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:30.637883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:30.638411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.639305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:30.639830 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.805225 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:30.821475 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-81c94852-4b1b-47a3-8004-ac551bd37e3d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.196048 Nov 22 10:35:30.824749 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 43/99] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:30 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:30.848738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-472cd895-517c-4b4a-b1c6-5ce8ae9349b3 req-67bac884-f789-4414-abc1-b5702d604f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516b0499-a733-410c-9a0c-6e98ff43aba0", "name": "network-vif-plugged", "status": "completed", "tag": "16c7e493-84ec-4f05-8c01-8c85e582654e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:30.850605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:30.850605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:30.859479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-472cd895-517c-4b4a-b1c6-5ce8ae9349b3 req-67bac884-f789-4414-abc1-b5702d604f96 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:30.859957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-472cd895-517c-4b4a-b1c6-5ce8ae9349b3 req-67bac884-f789-4414-abc1-b5702d604f96 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:30.884695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-472cd895-517c-4b4a-b1c6-5ce8ae9349b3 req-67bac884-f789-4414-abc1-b5702d604f96 service nova] Creating event network-vif-plugged:16c7e493-84ec-4f05-8c01-8c85e582654e for instance 516b0499-a733-410c-9a0c-6e98ff43aba0 on hv-cinder-80403 Nov 22 10:35:30.890326 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-472cd895-517c-4b4a-b1c6-5ce8ae9349b3 req-67bac884-f789-4414-abc1-b5702d604f96 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045519 Nov 22 10:35:30.891527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 57/100] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:31.040297 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:31.041042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:31.054979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.055877 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.056730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.057277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.338187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:31.361842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-71d09e6e-a4d5-4e16-978f-11e46650b1ff tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.327903 Nov 22 10:35:31.362454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 44/101] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:31 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:31.477736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:31.479608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:31.489628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.490092 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.490906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.491331 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.667851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:31.678786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:31.681049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:31.682210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2bfb2881-c304-404f-9c9c-4417acd3ac24 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1597 microversion: 2.20 time: 0.209465 Nov 22 10:35:31.682772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 58/102] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:35:31 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1597 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:35:31.703046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:31.703596 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:31.711310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.711803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.712795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.713366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.841904 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:31.842962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:31.844775 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-19aeb562-468c-4081-ae2e-ab0c5c588bc9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145496 Nov 22 10:35:31.845783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 45/103] 10.222.0.46 () {60 vars in 1315 bytes} [Mon Nov 22 10:35:31 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:35:31.867628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.868393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:31.869327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:31.869807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:32.156285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:32.164089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-30a12b1a-77e3-4f3f-a941-ca1e7249fbcd tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.326150 Nov 22 10:35:32.164686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 59/104] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:31 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:32.378407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:32.379029 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:32.385404 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:32.386216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:32.387051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:32.387546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:32.636198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:32.665623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ca30d494-85a8-4ceb-80a4-0ec2f6637e39 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.290287 Nov 22 10:35:32.666807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 46/105] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:32 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:33.185492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:33.186134 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:33.192638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.193761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.195885 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.196355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.371268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:33.379269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0830358f-64fb-4866-aca5-1493f1241f58 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.198425 Nov 22 10:35:33.379896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 60/106] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:33 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:33.649690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:33.651496 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-920106f3-f66b-475a-bebd-8e84019c482a req-611cd950-c469-4b97-b5b5-3ff006cdd7c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:33.651723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:33.653812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:33.653812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:33.659207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.659948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.661031 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.661568 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-920106f3-f66b-475a-bebd-8e84019c482a req-611cd950-c469-4b97-b5b5-3ff006cdd7c3 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.661762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.662223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-920106f3-f66b-475a-bebd-8e84019c482a req-611cd950-c469-4b97-b5b5-3ff006cdd7c3 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.675174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-920106f3-f66b-475a-bebd-8e84019c482a req-611cd950-c469-4b97-b5b5-3ff006cdd7c3 service nova] Creating event network-changed:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:35:33.680648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-920106f3-f66b-475a-bebd-8e84019c482a req-611cd950-c469-4b97-b5b5-3ff006cdd7c3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032911 Nov 22 10:35:33.681426 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 61/107] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:35:33.690421 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:33.691254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:33.699091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.699645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.700697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:33.701381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:33.869736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:33.877481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db95d4da-9590-4b0f-983a-0b021c009da1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.191244 Nov 22 10:35:33.878079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 62/108] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:33 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:34.396851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:34.397545 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:34.404110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:34.404583 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:34.405468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:34.405896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:34.545761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:34.553637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ef27353e-f887-4437-9dfd-3681300d9d77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.160612 Nov 22 10:35:34.554682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 63/109] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:34 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:34.894782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:34.895476 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:34.902212 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:34.902673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:34.903526 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:34.904046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:35.044291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:35.051978 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bac5996b-9dd1-4dc5-9733-677e53d3f434 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.160900 Nov 22 10:35:35.052576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 64/110] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:34 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:35.571609 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:35.572403 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:35.578898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:35.579340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:35.580158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:35.580582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:35.696673 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a898cd3b-ec46-43e2-8848-20a829a1b851 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 2.050906 Nov 22 10:35:35.698364 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 47/111] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:33 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:35.757183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:35.765185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5ee9396c-a75d-42d5-9a3a-2cfdd47ff8ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1361 microversion: 2.1 time: 0.197528 Nov 22 10:35:35.765775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 65/112] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:35 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:36.070353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:36.071186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:36.078712 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.079135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.080274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.080779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.346366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:36.356016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0b539dcb-2372-45a0-a5e0-ed1dc2c57415 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.289955 Nov 22 10:35:36.356686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 48/113] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:36 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:36.708887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:36.709886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:36.721411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.722513 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.725207 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.725617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.782446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:36.783965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:36.791511 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.792004 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.792793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:36.793229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:36.853311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-14b4221e-0239-4168-8cc9-9c0d3b11678c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.147619 Nov 22 10:35:36.854074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 66/114] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:36 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:36.965806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:36.973057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-79660154-63d7-4b2c-be65-9c70b935fe73 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1546 microversion: 2.1 time: 0.194302 Nov 22 10:35:36.984202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 49/115] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:36 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:36.994386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:36.995148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:37.002547 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.003008 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.003851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.004286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.084933 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:37.086094 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:37.092132 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.092583 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.093662 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.094276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.113462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ebaa7b6a-609f-4acd-9d6a-5c8a50288808 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125177 Nov 22 10:35:37.114324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 67/116] 10.222.0.46 () {58 vars in 1274 bytes} [Mon Nov 22 10:35:36 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:37.140380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:35:37.278719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-796f29e6-c2db-4c6f-8bd9-41248d4e701b tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 204 len: 0 microversion: 2.1 time: 0.195989 Nov 22 10:35:37.282950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 50/117] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:35:37 2021] DELETE /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:35:37.288738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:37.289588 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:37.295949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.296471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.297221 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.298357 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.379656 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:37.380814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:37.389330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.389973 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.390936 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.391376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.808657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:37.820496 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-dc44b453-878a-4ae0-b083-96dd88447a54 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.445219 Nov 22 10:35:37.821119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 51/118] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:37 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:37.873700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:37.882965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:37.884972 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-87e11080-10a7-4e60-be32-32026d2db137 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1554 microversion: 2.1 time: 0.600930 Nov 22 10:35:37.886736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:37.895435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 68/119] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:37 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1554 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:37.904777 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.905611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.906592 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:37.907201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:37.988912 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-678765ed-bb28-406f-a540-1821a47d2a7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.121999 Nov 22 10:35:37.990412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 52/120] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:37 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:38.842371 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:38.842993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:38.886335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:38.887023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:38.889417 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:38.889951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:38.905542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:38.906256 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:38.932995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:38.934510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:38.944458 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:38.945032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.342430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:39.355015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-26c9967f-4767-409c-9551-7a516b0f2455 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1554 microversion: 2.1 time: 0.456021 Nov 22 10:35:39.360429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:39.369977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9587a952-de3b-4887-8421-a73d7c955a0f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.532247 Nov 22 10:35:39.373786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 69/122] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:38 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:39.373919 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 53/122] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:38 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1554 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:39.382876 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:39.385690 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:39.389997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:39.391843 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:39.396705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:39.397151 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.397938 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:39.398391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.399048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:39.399787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.400828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:39.401487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.489616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1c230ed9-de7d-4762-9c3b-6b5c69345e52 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.114200 Nov 22 10:35:39.490249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 54/123] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:39 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:39.496527 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-60bc4674-3a8f-446d-b167-938fca86fdab req-6d9fadf2-7efb-4911-9bbd-d3066d93b75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516b0499-a733-410c-9a0c-6e98ff43aba0", "tag": "16c7e493-84ec-4f05-8c01-8c85e582654e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:39.498046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:39.498046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:35:39.514945 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cf8cf3a3-2753-44a1-a3ff-864f4f9d311c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.138676 Nov 22 10:35:39.515999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 70/124] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:39 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:35:39.522149 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-60bc4674-3a8f-446d-b167-938fca86fdab req-6d9fadf2-7efb-4911-9bbd-d3066d93b75a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:39.522672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-60bc4674-3a8f-446d-b167-938fca86fdab req-6d9fadf2-7efb-4911-9bbd-d3066d93b75a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:39.551251 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-60bc4674-3a8f-446d-b167-938fca86fdab req-6d9fadf2-7efb-4911-9bbd-d3066d93b75a service nova] Creating event network-changed:16c7e493-84ec-4f05-8c01-8c85e582654e for instance 516b0499-a733-410c-9a0c-6e98ff43aba0 on hv-cinder-80403 Nov 22 10:35:39.559899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-60bc4674-3a8f-446d-b167-938fca86fdab req-6d9fadf2-7efb-4911-9bbd-d3066d93b75a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067550 Nov 22 10:35:39.560610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 55/125] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:40.385668 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:40.393309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:40.394005 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:40.396817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:40.412758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:40.424097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:40.425137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:40.425580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:40.426884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:40.427330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:40.428156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:40.428590 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.136181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:41.137268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a927df2c1644bb4a08713d0d5d1f24a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df68136f15294909b23428e0edcd740d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:41.149370 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-70847b01-3304-489b-b9cc-493854c9bc4c tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.761028 Nov 22 10:35:41.149813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c0462c19-eb99-45cf-bb95-6b0453ee0658 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 200 len: 1554 microversion: 2.1 time: 0.771343 Nov 22 10:35:41.150370 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 56/126] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:40 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:41.166041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 71/127] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:40 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 1554 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:41.166041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:41.166041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:41.178305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:41.179268 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:41.180596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:41.181205 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.181999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:41.182423 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.188829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:41.189250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.190209 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:41.190784 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.259569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f198be08-32f6-4440-bc7e-548b9d11786d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.106623 Nov 22 10:35:41.260427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 72/128] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:41 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:41.266291 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a62a9c25-d2c6-460a-8b18-6e5a3d92244f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.097744 Nov 22 10:35:41.269614 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 57/129] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:41 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:35:41.580077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-d83efdd1-e707-446f-a429-4d57bc5f9296 req-e95bb2af-7e1c-4402-9b96-1cbb64e056ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fa7b826-3fcb-47c6-8301-f88892120095", "name": "network-vif-deleted", "tag": "a26d823d-0945-45d5-b889-984e5d69086e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:41.582903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:41.582903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:35:41.596168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d83efdd1-e707-446f-a429-4d57bc5f9296 req-e95bb2af-7e1c-4402-9b96-1cbb64e056ce service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:41.596797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d83efdd1-e707-446f-a429-4d57bc5f9296 req-e95bb2af-7e1c-4402-9b96-1cbb64e056ce service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:41.614368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-d83efdd1-e707-446f-a429-4d57bc5f9296 req-e95bb2af-7e1c-4402-9b96-1cbb64e056ce service nova] Creating event network-vif-deleted:a26d823d-0945-45d5-b889-984e5d69086e for instance 0fa7b826-3fcb-47c6-8301-f88892120095 on hv-cinder-80403 Nov 22 10:35:41.620391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-d83efdd1-e707-446f-a429-4d57bc5f9296 req-e95bb2af-7e1c-4402-9b96-1cbb64e056ce service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044436 Nov 22 10:35:41.620987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 73/130] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:42.183070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:42.183851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:42.192876 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:42.193589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:42.193800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.194264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.195906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.196790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.201740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.202387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.203355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.204100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.221963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] HTTP exception thrown: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. Nov 22 10:35:42.222585 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Returning 404 to user: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:35:42.223776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-45e07519-edc8-48ca-b19a-8107ce619866 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 404 len: 111 microversion: 2.1 time: 0.036876 Nov 22 10:35:42.224645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 74/131] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:42 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:35:42.276961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:42.278425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:42.289803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.290540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.292180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.292972 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.380106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0867a311-6bb1-430f-8580-5a559be369e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.111717 Nov 22 10:35:42.381085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 75/132] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:42 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:42.387505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:42.388627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:42.403720 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.404251 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.405147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.405772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.420746 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:42.435082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-eaad27ce-9f1d-4542-bf46-7205793fb837 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.255832 Nov 22 10:35:42.448013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 58/133] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:42 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:42.453389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:42.454947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:42.462033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.462871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.463950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:42.464607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:42.486706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] HTTP exception thrown: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. Nov 22 10:35:42.487310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Returning 404 to user: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:35:42.488195 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2970f1e2-ebe7-4b96-a280-2d5ca558bca4 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038983 Nov 22 10:35:42.488779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 59/134] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:35:42 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:35:42.499480 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6351ffa1-2212-42e7-82be-3c9f8a5ded9e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.116765 Nov 22 10:35:42.500290 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 76/135] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:42 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:35:43.391008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:43.391968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:43.398374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.398827 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.399606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.400066 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.455270 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:43.456636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:43.465413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.466072 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.466982 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.467842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.477400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b3f9633e-b141-4682-b17c-61a3a8d2f374 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.089809 Nov 22 10:35:43.479300 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 60/136] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:43 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:43.512696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:43.513822 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:43.520979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.521519 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.522395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.523006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.590921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9e06afaf-0c1c-4a11-8831-327df440f5fc tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.082159 Nov 22 10:35:43.594934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 61/137] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:43 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:35:43.631390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:43.639572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-058d4ac5-4a9f-4948-b40d-2f07cbe5c423 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.188865 Nov 22 10:35:43.640310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 77/138] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:43 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:43.689793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:43.690413 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:43.698399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.699046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.700044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.700632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.717448 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] HTTP exception thrown: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. Nov 22 10:35:43.718245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Returning 404 to user: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:35:43.719101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0b9d4de4-5481-406b-b7f0-4f21ad2c8559 tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 404 len: 111 microversion: 2.1 time: 0.033703 Nov 22 10:35:43.719701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 62/139] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:35:43 2021] DELETE /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:35:43.728577 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:43.729188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] [instance: 0fa7b826-3fcb-47c6-8301-f88892120095] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:43.735381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.735749 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.736537 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:43.736999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:43.754276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] HTTP exception thrown: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. Nov 22 10:35:43.754844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] Returning 404 to user: Instance 0fa7b826-3fcb-47c6-8301-f88892120095 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:35:43.755936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9d06dd06-0e09-4f47-bda2-0bbebd2dfe9e tempest-DeleteServersTestJSON-97510847 tempest-DeleteServersTestJSON-97510847-project] 10.222.0.46 "GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095" status: 404 len: 111 microversion: 2.1 time: 0.031663 Nov 22 10:35:43.757018 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 78/140] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:43 2021] GET /compute/v2.1/servers/0fa7b826-3fcb-47c6-8301-f88892120095 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:35:44.489233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:44.490169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:44.498003 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.498465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.499254 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.499725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.581386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-27f2a748-6b2f-4f71-a3b3-5ab2a487408c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.095049 Nov 22 10:35:44.582100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 63/141] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:44 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:44.603202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:44.604157 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:44.610817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.611613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.612720 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.613304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.657870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:44.658580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:44.676460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.676811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.677900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:44.678553 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:44.698008 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-893eb022-b999-4148-857c-99c5141921f8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.099014 Nov 22 10:35:44.700814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 79/142] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:44 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:35:44.871834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:44.880157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7e2664af-1ead-481c-b54a-84f447cba88d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.226279 Nov 22 10:35:44.891016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 64/143] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:44 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:45.594389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:45.595409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:45.603378 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.604043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:45.604643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.605187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:45.679106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c6dd51ac-e6a4-48c6-8324-0c738ea92c08 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 14 microversion: 2.20 time: 0.088508 Nov 22 10:35:45.682640 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 80/144] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:45 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:45.711438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:45.712311 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:45.718417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.718858 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:45.719652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.720098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:45.786208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cc34c597-22a8-410b-a9c3-5064cf2eaebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 14 microversion: 2.1 time: 0.078509 Nov 22 10:35:45.787001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 65/145] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:45 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:35:45.897700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:45.898555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:45.905905 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.906353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:45.907136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:45.907556 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:46.055691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:46.064953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-06e9fac4-5a0d-418c-96fe-40a5baffdf14 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.171328 Nov 22 10:35:46.065748 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 81/146] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:45 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:46.681394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-210135727", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "75fe944d-7f58-47aa-b60a-343caa9b99aa"}]}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:46.793795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1902665844", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "1739dec4-235e-4240-8471-290e5b4cd168"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:52.986086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] validate_networks() for [('75fe944d-7f58-47aa-b60a-343caa9b99aa', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:35:52.991417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] validate_networks() for [('1739dec4-235e-4240-8471-290e5b4cd168', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:35:53.836884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:53.837388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:53.837877 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:53.838620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:53.839029 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:53.840852 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:35:53.841270 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:35:53.841730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:35:53.842128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:35:53.842514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:35:53.848415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.848859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.849701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.850127 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.851076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.851520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.852736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.853260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.866754 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Getting quotas for project 4aa86d766a954554b6dc79984ed36bd5. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:53.870831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Getting quotas for user da06abf9d3ee47fb803c8fcc065d54af and project 4aa86d766a954554b6dc79984ed36bd5. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:53.871033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:35:53.875076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for user d68748d566954625ac4a353c2a08b253 and project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:35:53.882287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:53.884697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:53.886172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:35:53.888648 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:35:53.935595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-50375d19-3d56-4fa1-bed4-0319c2e50f79 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.317418 Nov 22 10:35:53.936109 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-25df7b71-1a1a-4d7a-b445-3989900dab39 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.260264 Nov 22 10:35:53.941969 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 82/148] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:35:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 7262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 10:35:53.944134 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:53.944812 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 66/148] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:35:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 7320 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:35:53.945287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:53.950822 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:53.953096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.953515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:53.953622 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.954351 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.954951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.961086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.961552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:53.962440 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:53.962890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:54.052909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f8f2f7a0-2d9b-4411-9d46-006b8f787c89 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 22892 microversion: 2.20 time: 0.114786 Nov 22 10:35:54.054864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 83/149] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:53 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 22892 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:54.061086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:54.063126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:54.071890 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:54.072459 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:54.076707 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:54.077198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:54.084572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2b83cf42-76e0-400b-be39-73f2f62a1b3c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 6099 microversion: 2.1 time: 0.138030 Nov 22 10:35:54.085396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 67/150] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:53 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 6099 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:54.092639 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8a9fcd3c-66b2-4c21-9592-b728b4deb97c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:54.093603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8a9fcd3c-66b2-4c21-9592-b728b4deb97c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:54.171876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8a9fcd3c-66b2-4c21-9592-b728b4deb97c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:54.180218 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8a9fcd3c-66b2-4c21-9592-b728b4deb97c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1218 microversion: 2.1 time: 0.093369 Nov 22 10:35:54.193751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 68/151] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:54 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:54.199202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-329dc52b-3f8d-4ed5-9823-92dd272d9680 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:54.201839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-329dc52b-3f8d-4ed5-9823-92dd272d9680 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:54.269324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-329dc52b-3f8d-4ed5-9823-92dd272d9680 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:54.276447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-329dc52b-3f8d-4ed5-9823-92dd272d9680 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1213 microversion: 2.1 time: 0.081173 Nov 22 10:35:54.277059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 69/152] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:54 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:54.344926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:54.356199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-816ba732-29f8-4897-b2ef-8dca6b771028 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.299489 Nov 22 10:35:54.356776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 84/153] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:54 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:55.069844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:55.071246 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:55.080503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.080972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.081780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.082233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.096490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:55.097695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:55.105895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.106355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.107125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.107553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.165645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a81fba86-aba6-4d0b-b849-270b8b3bb7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 23964 microversion: 2.20 time: 0.100908 Nov 22 10:35:55.167190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 70/154] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:55 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 23964 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:55.192686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d3b7786f-520d-4a65-91e6-a16492a69911 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 11454 microversion: 2.1 time: 0.099752 Nov 22 10:35:55.193716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 85/155] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:55 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 11454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:35:55.198674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:55.199549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:55.207129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.207539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.208565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.208984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.295986 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-948f8e82-14b3-4161-8898-e25dbb6e246b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:55.296702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-948f8e82-14b3-4161-8898-e25dbb6e246b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:55.303012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:55.344485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4eb45bcf-4743-42b2-b4ed-3511561773b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1278 microversion: 2.1 time: 0.149984 Nov 22 10:35:55.361189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 71/156] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:55 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1278 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:55.374881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:55.375534 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:55.384058 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.390820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.392138 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:55.392783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:55.407742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-948f8e82-14b3-4161-8898-e25dbb6e246b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:55.421412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-948f8e82-14b3-4161-8898-e25dbb6e246b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1213 microversion: 2.1 time: 0.129511 Nov 22 10:35:55.429381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 86/157] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:55 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:55.652745 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:55.660865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9de79760-de3a-481d-ae92-9e928f1506bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.289652 Nov 22 10:35:55.661910 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 72/158] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:55 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:35:56.179512 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:56.180965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:56.191416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.191879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.192718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.193145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.211275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:56.212706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:56.222835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.223446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.224675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.225617 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.298244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-32127631-4fe4-43c6-95a8-f2a37b9e6ebd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 25095 microversion: 2.20 time: 0.122920 Nov 22 10:35:56.298918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 87/159] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:56 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 25095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:56.336020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f99dd0df-d5bf-457a-b7ca-b1744904e60a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 16217 microversion: 2.1 time: 0.133722 Nov 22 10:35:56.338128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 73/160] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:56 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 16217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:35:56.369484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:56.370368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:56.377778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.378228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.379015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.379440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.452123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:56.452919 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:56.460224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.460935 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.461726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.468096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.581885 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:56.590041 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-640b9321-29d7-450e-9529-2bc5958676fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1271 microversion: 2.1 time: 0.143384 Nov 22 10:35:56.595973 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 74/161] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:56 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1271 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:56.678769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:56.679493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:56.687103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.687558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.688400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:56.688846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:56.749353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:56.757481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c8942aff-489e-4aa6-be21-6915cb0280cf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.392125 Nov 22 10:35:56.758082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 88/162] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:56 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:57.049017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:57.057946 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-58a99da0-cdcf-4eba-af92-d2206230991b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.382889 Nov 22 10:35:57.058550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 75/163] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:56 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:57.311147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:57.312348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:57.319858 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-f860004e-f2ea-41dd-87f4-a0a7bca309d1 req-b9aeaf4b-f0bb-4fb6-a43a-5d1b0ec8fd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27f777b2-7bd2-46fa-bd38-e601e5a904a7", "tag": "7b29c6e7-c1ba-4983-ab04-3db1251a4a72"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:57.322081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:57.322081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:35:57.325799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.326961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.333266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.333908 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.335603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f860004e-f2ea-41dd-87f4-a0a7bca309d1 req-b9aeaf4b-f0bb-4fb6-a43a-5d1b0ec8fd21 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.336278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f860004e-f2ea-41dd-87f4-a0a7bca309d1 req-b9aeaf4b-f0bb-4fb6-a43a-5d1b0ec8fd21 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.353526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-f860004e-f2ea-41dd-87f4-a0a7bca309d1 req-b9aeaf4b-f0bb-4fb6-a43a-5d1b0ec8fd21 service nova] Creating event network-changed:7b29c6e7-c1ba-4983-ab04-3db1251a4a72 for instance 27f777b2-7bd2-46fa-bd38-e601e5a904a7 on hv-cinder-80403 Nov 22 10:35:57.359334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-f860004e-f2ea-41dd-87f4-a0a7bca309d1 req-b9aeaf4b-f0bb-4fb6-a43a-5d1b0ec8fd21 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044737 Nov 22 10:35:57.360451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 76/164] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:57.366369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:57.367720 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:57.376833 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.377596 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.378425 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.378854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.433897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8195f203-c7ca-4636-90b4-58ef0d494f22 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 26194 microversion: 2.20 time: 0.127535 Nov 22 10:35:57.435700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 89/165] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:57 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 26194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:57.468094 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-68d3fbd7-99f2-4637-a864-b2a78d47df67 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 17861 microversion: 2.1 time: 0.106105 Nov 22 10:35:57.479691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 77/166] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:57 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 17861 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:35:57.609792 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:57.610991 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:57.620873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.621449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.622335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.622830 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.776272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:57.777118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:57.786016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.786551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:57.787468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:57.787906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.374798 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:58.382857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3ed37121-8cd4-4ba0-9723-7d8e5c70b0f8 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.778746 Nov 22 10:35:58.383559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 90/167] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:57 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:58.397156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:58.397765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:58.404262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.404710 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.405579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.406031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.531197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:58.539239 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-40b43fa1-4a1c-4a1c-bcec-6e7fd10de55a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.767592 Nov 22 10:35:58.539972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 78/168] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:57 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:58.547304 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:58.548322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:58.556368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.556918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.557744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.558172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.663633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b7088cda-a253-40e5-babc-6618913a90bf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 27086 microversion: 2.20 time: 0.121863 Nov 22 10:35:58.664333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 79/169] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:58 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 27086 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:58.670047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:58.671075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:58.678577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.679032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.680176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:58.680597 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:58.761407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-99fb9081-6241-457c-82c5-6207b88faa38 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 19342 microversion: 2.1 time: 0.095636 Nov 22 10:35:58.762417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 80/170] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:58 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 19342 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:35:58.770693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:58.779652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6f46cadf-5ff3-456e-97b2-52ec814463b8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.386059 Nov 22 10:35:58.780450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 91/171] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:58 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:59.379000 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-f693b317-6924-40fe-b042-029e3976f12c req-b149ab75-7da9-4b10-aad8-7013e5bed2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b", "tag": "6d52f987-a868-4d8b-868b-4eda9ec40635"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:59.380695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:35:59.380695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:35:59.389871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f693b317-6924-40fe-b042-029e3976f12c req-b149ab75-7da9-4b10-aad8-7013e5bed2b5 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.390314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f693b317-6924-40fe-b042-029e3976f12c req-b149ab75-7da9-4b10-aad8-7013e5bed2b5 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.400344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:59.400954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:59.404462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-f693b317-6924-40fe-b042-029e3976f12c req-b149ab75-7da9-4b10-aad8-7013e5bed2b5 service nova] Creating event network-changed:6d52f987-a868-4d8b-868b-4eda9ec40635 for instance 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b on hv-cinder-80403 Nov 22 10:35:59.407204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.408550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.409579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.409803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-f693b317-6924-40fe-b042-029e3976f12c req-b149ab75-7da9-4b10-aad8-7013e5bed2b5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035647 Nov 22 10:35:59.410025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.410417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 81/172] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:35:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:35:59.558360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:59.559069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:59.565396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.565845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.566609 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.567057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.673884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:59.681484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-07635228-ee17-4666-ad36-50274357f25b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.285184 Nov 22 10:35:59.682077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 92/173] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:59 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:59.686656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:59.687802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:59.693936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.694385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.695206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.695637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.774055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7f14d80f-442d-4cb6-b8fd-5303abd82d82 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 27611 microversion: 2.20 time: 0.090682 Nov 22 10:35:59.775557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 93/174] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:35:59 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 27611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:35:59.780377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:35:59.781384 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:59.788832 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.789288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.790139 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.790811 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.850900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:35:59.859104 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e20fb393-7973-46f2-afe8-88584ea9ef98 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.305533 Nov 22 10:35:59.866543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 82/175] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:59 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:35:59.866543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:35:59.866543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:35:59.871938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.872663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.873447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:35:59.873871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:35:59.875304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9c34d610-a23a-4adf-a188-ccf8ddab049b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 21790 microversion: 2.1 time: 0.098631 Nov 22 10:35:59.876060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 94/176] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:35:59 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 21790 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:00.104755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:00.116925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-470e6ee3-41e7-49c1-ad26-e0cf537361d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.255710 Nov 22 10:36:00.127716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 83/177] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:35:59 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:00.701249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:00.702007 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:00.711824 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.712426 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.714349 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.714777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.788978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:00.789900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:00.796467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.796916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.797706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.798134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.869034 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:00.876851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bf8bf47b-7959-4443-bffc-69edf7d83181 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.181743 Nov 22 10:36:00.877435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 95/178] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:00 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:00.881749 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:00.882352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:00.891518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.892430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6b74dfea-6e33-43d8-bde9-3882c6a61f6d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 27910 microversion: 2.20 time: 0.107316 Nov 22 10:36:00.892612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.893173 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 84/179] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:00 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 27910 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:36:00.893767 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.894495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.898799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:00.900439 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:00.907840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.908285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.909083 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:00.909510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:00.989375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-687f0d9f-ea02-4e8d-a5aa-119aa2552ddb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 23043 microversion: 2.1 time: 0.092710 Nov 22 10:36:00.990333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 85/180] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:00 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 23043 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:01.049087 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:01.057913 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-829ab144-ca12-48f6-820c-02a1dd778e40 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.179222 Nov 22 10:36:01.058498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 96/181] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:00 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:01.135830 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:01.136582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:01.144173 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.144633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:01.145437 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.145866 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:01.300830 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:01.309343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-effde0bd-28ec-4859-8c8d-e9c1c229b1ca tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.178258 Nov 22 10:36:01.310457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 86/182] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:01 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:01.899055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:01.899705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:01.906798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:01.907365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.907365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:01.908171 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.908770 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:01.909124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:01.915938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.916641 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:01.917572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:01.918044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.019397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1982e0c0-8f05-41cf-9d0c-25895a1303ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28203 microversion: 2.20 time: 0.116158 Nov 22 10:36:02.021403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 87/183] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:01 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:02.025655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:02.026829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:02.035517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.036163 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.036951 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.037395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.047869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:02.055512 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d847f566-a8e7-435c-82fc-9c0bbbfa76e4 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.160260 Nov 22 10:36:02.056365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 97/184] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:01 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:02.077331 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:02.077947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:02.084516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.084960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.085731 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.086159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.159530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7cfae255-fa81-4c61-a560-177c2cea2bf5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 23884 microversion: 2.1 time: 0.137402 Nov 22 10:36:02.163751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 88/185] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:02 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 23884 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:02.224201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:02.232247 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-30ba009b-6d4d-4191-806d-e96ca27ecef1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.158642 Nov 22 10:36:02.232903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 98/186] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:02 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:02.329424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:02.330151 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:02.338051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.338837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.339739 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:02.340227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:02.479250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:02.487189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5845b7d6-cf12-4c76-8adb-7f6ba85af229 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.161990 Nov 22 10:36:02.487863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 89/187] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:02 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:03.032317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:03.033226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:03.040582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.041162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.041960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.042394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.074670 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:03.075303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:03.082215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.082663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.083616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.084093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.116561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ad4cee05-1ad1-4407-8779-1b184f90c71f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28203 microversion: 2.20 time: 0.088280 Nov 22 10:36:03.117193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 99/188] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:03 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:03.172293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:03.173355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:03.180608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.181209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.182064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.182500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.265795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:03.273790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c38202de-dd15-4fe5-812c-3e2f05e96c64 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.204643 Nov 22 10:36:03.287363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 90/189] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:03 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:03.287706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6eaaec46-2f28-4e11-bac2-2522cd353f32 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 24523 microversion: 2.1 time: 0.108960 Nov 22 10:36:03.287706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 100/190] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:03 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 24523 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:03.287863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:03.287863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:03.287863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.287863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.288133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.288133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.444018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:03.453341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f9f7c172-babf-44d8-b048-498eea0b5ab3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.177912 Nov 22 10:36:03.453970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 91/191] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:03 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:03.504588 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:03.505310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:03.512995 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.513462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.514249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:03.514679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:03.657654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:03.665725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1af35356-bcd6-4ff5-a2a4-60fb708de263 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1521 microversion: 2.1 time: 0.165241 Nov 22 10:36:03.666343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 101/192] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:03 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:04.129883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:04.130909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.138236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.138670 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.139485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.139957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.210733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0d2eeac3-89f6-4583-9644-34eca72fb89a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28203 microversion: 2.20 time: 0.084507 Nov 22 10:36:04.211402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 92/193] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:04 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:04.291414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:04.292663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.294728 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:04.295472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.299643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.300151 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.300932 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.301396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.302710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.303140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.303938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.304396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.402067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e5e056e0-351e-4320-aae3-13c5e36325e4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 25051 microversion: 2.1 time: 0.114949 Nov 22 10:36:04.403102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 102/194] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:04 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 25051 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:04.452307 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:04.461942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3b7c3e27-d929-4c66-8c2e-d938f3ce93f7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.171340 Nov 22 10:36:04.462616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 93/195] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:04 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:04.474194 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:04.474902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.483519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.483991 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.484787 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.485217 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.627980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:04.638172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1a13667c-a237-4dc4-8cb9-38cdd75cce5f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.168255 Nov 22 10:36:04.639120 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 103/196] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:04 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:04.682738 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:04.683266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.689803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.690713 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.691034 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.691496 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.828980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:04.836332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-801f6b7b-b091-4845-8969-5fbed9e2d6c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1501 microversion: 2.1 time: 0.157486 Nov 22 10:36:04.836913 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 94/197] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:04 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:04.853741 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:04.854508 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:04.862229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.862717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:04.863686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:04.864189 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.004689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:05.016267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f197fc12-46c7-428d-aa0b-d22fe7f04eea tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1516 microversion: 2.1 time: 0.166900 Nov 22 10:36:05.016907 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 104/198] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:04 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:05.223397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:05.224694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:05.232869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.233682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.234796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.235452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.315979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-39bad6ef-985f-4442-993b-34110bb526a1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28203 microversion: 2.20 time: 0.096264 Nov 22 10:36:05.320119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 95/199] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:05 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28203 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:05.414152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:05.415322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:05.422550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.423003 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.423839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.424276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.479862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:05.480585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:05.487961 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.488430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.489228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.489667 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.511697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6df3f3d1-978a-48bb-8dc3-88ea408f85ee tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 25539 microversion: 2.1 time: 0.101060 Nov 22 10:36:05.512766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 105/200] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:05 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 25539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:05.635571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:05.643881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b8e8a81d-24f9-4b5b-ad34-313457b300ad tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.168545 Nov 22 10:36:05.646599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 96/201] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:05 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:05.657035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:05.657740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:05.667167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.667828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.668662 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:05.669098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:05.819897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:05.828358 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8c298570-2023-4c44-adf2-7d3472d4eda5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.175512 Nov 22 10:36:05.829413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 106/202] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:05 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:06.328055 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:06.329105 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.338214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.338734 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.339565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.340046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.391334 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:06.392320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.399021 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.399465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.400988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.401424 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.426626 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lazy-loading 'flavor' on Instance uuid 60ede0be-83f5-416b-8ba7-216691a79cbc {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:36:06.438083 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-31f57243-b2c4-49fc-8378-b5edfaed5178 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28416 microversion: 2.20 time: 0.113765 Nov 22 10:36:06.439711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 97/203] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:06 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28416 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:06.524424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:06.527696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.537407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.537918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.538713 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.539142 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.565028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2fdadab0-c1fb-4974-ab9a-602ea3bad8fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action" status: 200 len: 32 microversion: 2.1 time: 0.177357 Nov 22 10:36:06.565697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 107/204] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:06 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:36:06.581402 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:06.582008 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.589551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.589995 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.590782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.591354 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.641158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3e8e6eb3-a703-42f6-8e06-36b4f735c966 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 26170 microversion: 2.1 time: 0.120618 Nov 22 10:36:06.641942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 98/205] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:06 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 26170 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:06.668081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:06.669157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.676767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.677432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.678335 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.678799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.834307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:06.844223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-45aef4f9-0951-4ad6-9d4a-1172be08e78a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.272620 Nov 22 10:36:06.844852 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 108/206] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:06 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:06.849559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:06.849815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:06.856968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.857410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:06.858190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:06.858622 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.000162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:07.008405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-74348be7-494f-4c3b-a3bb-8a5d62c0c954 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.345963 Nov 22 10:36:07.008995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 99/207] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:06 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:07.126149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:07.133759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1b663004-d7d1-4cd8-9f0c-6a2d072f3527 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.287910 Nov 22 10:36:07.134671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 109/208] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:06 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:07.452809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:07.453795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:07.461285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.461792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.462977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.463500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.553530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c6dc7113-dda0-4127-aaaa-ae3facb7c7e8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28494 microversion: 2.20 time: 0.105224 Nov 22 10:36:07.558070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 100/209] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:07 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28494 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:07.653692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:07.654652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:07.661291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.661775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.662584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.663025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.756243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-395d12f9-7dbd-4bfa-afba-aa9b1f8563f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 26778 microversion: 2.1 time: 0.105926 Nov 22 10:36:07.756741 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 110/210] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:07 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 26778 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:07.863116 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:07.863806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:07.871043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.871499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:07.872322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:07.872760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.017133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:08.029690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f20a2713-ca77-4d3e-b68d-f53aaebbdc46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.170498 Nov 22 10:36:08.030703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 101/211] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:07 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:08.031359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:08.032740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:08.042491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.043485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.044646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.045309 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.151276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:08.152020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:08.159329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.160248 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.163711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.164242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.202257 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:08.211394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9122495a-e8a9-4c02-b780-721e7a253f8a tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.188919 Nov 22 10:36:08.212049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 111/212] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:08 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:08.313054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:08.321122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7bb2d5ff-27b0-4fbe-8ff9-cbcd3d31d45d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.174039 Nov 22 10:36:08.321722 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 102/213] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:08 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:08.566847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:08.567832 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:08.575070 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.575682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.576491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.576938 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.677828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a994c398-9f5e-4f14-ac76-83844efb1f5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28494 microversion: 2.20 time: 0.115205 Nov 22 10:36:08.678607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 112/214] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:08 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28494 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:08.768780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:08.770365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:08.778013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.778518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.779316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.779774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.876895 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b6277617-b9d6-4a2d-87d4-0a7f23ad2f6a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 27448 microversion: 2.1 time: 0.112028 Nov 22 10:36:08.883287 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 103/215] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:08 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 27448 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:08.936178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-aa1c7964-5595-4088-8b2a-5ba310945f81 req-62cb1c64-a77a-4d03-96dc-e925f7bae399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b", "name": "network-vif-plugged", "status": "completed", "tag": "6d52f987-a868-4d8b-868b-4eda9ec40635"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:08.939115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:08.939115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:08.961331 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-aa1c7964-5595-4088-8b2a-5ba310945f81 req-62cb1c64-a77a-4d03-96dc-e925f7bae399 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:08.962376 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-aa1c7964-5595-4088-8b2a-5ba310945f81 req-62cb1c64-a77a-4d03-96dc-e925f7bae399 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:08.986968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-aa1c7964-5595-4088-8b2a-5ba310945f81 req-62cb1c64-a77a-4d03-96dc-e925f7bae399 service nova] Creating event network-vif-plugged:6d52f987-a868-4d8b-868b-4eda9ec40635 for instance 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b on hv-cinder-80403 Nov 22 10:36:08.991817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-aa1c7964-5595-4088-8b2a-5ba310945f81 req-62cb1c64-a77a-4d03-96dc-e925f7bae399 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059793 Nov 22 10:36:08.992892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 113/216] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:09.048723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:09.049711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:09.067486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.086303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.088868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.091057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.230327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:09.231757 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:09.241584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.242991 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.244113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.245307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.605057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:09.616631 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7ef576ff-511e-4956-866d-e4fb6aa85f96 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.571980 Nov 22 10:36:09.617463 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 104/217] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:09 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:09.635650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:09.636352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:09.643269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.643763 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.644552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.644979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.689246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:09.699553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e6aee945-b20f-4f88-90c2-e6672ccadd3f tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.474217 Nov 22 10:36:09.700202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 114/218] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:09 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:09.713732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:09.714702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:09.721249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.721687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.722482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.722909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.805685 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:09.813444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d920bcdb-e7be-455c-8e1c-a994ade87f66 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.182524 Nov 22 10:36:09.814048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 105/219] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:09 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:09.889289 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:09.890214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:09.896501 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.896812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-361a0402-cd21-4bab-ad89-bb14306e3674 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.194840 Nov 22 10:36:09.897081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.897631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 115/220] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:09 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:09.897995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:09.898454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:09.992727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fe241a17-553d-40f9-80b3-1358c3495606 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 27768 microversion: 2.1 time: 0.106796 Nov 22 10:36:09.996928 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 106/221] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:09 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 27768 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:10.635228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:10.635951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:10.644186 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.644710 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.645415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.645846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.718123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:10.719043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:10.727188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.727634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.728716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.730008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.840786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:10.849075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6d29847b-ed03-4891-a640-302acd6f4e42 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.218170 Nov 22 10:36:10.860110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 116/222] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:10 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:10.865153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:10.865957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:10.872977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.873416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.874202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.874789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.936399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:10.949619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-da0dad5d-4cb8-46ac-be0c-3251b6352992 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1313 microversion: 2.1 time: 0.235280 Nov 22 10:36:10.950969 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 107/223] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:10 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:10.956802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:10.958048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:10.968126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.968822 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:10.969817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:10.970392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.046498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8857e625-7caf-474e-92b5-d06470638abb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.093809 Nov 22 10:36:11.047239 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 108/224] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:10 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:11.054832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:11.059383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:11.073457 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5df78ddd-2042-4f42-92af-7e240c58ba7b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.211917 Nov 22 10:36:11.074063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 117/225] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:10 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:11.076041 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:11.084309 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-130de797-9630-42ed-9fa1-b594e198bed8 req-e7a40d13-55e0-46b8-8e6b-017247cff922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f777b2-7bd2-46fa-bd38-e601e5a904a7", "name": "network-vif-plugged", "status": "completed", "tag": "7b29c6e7-c1ba-4983-ab04-3db1251a4a72"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:11.085886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:11.085886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:11.090301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.091020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.092555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.093271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-130de797-9630-42ed-9fa1-b594e198bed8 req-e7a40d13-55e0-46b8-8e6b-017247cff922 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.093520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.093699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-130de797-9630-42ed-9fa1-b594e198bed8 req-e7a40d13-55e0-46b8-8e6b-017247cff922 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.105975 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-130de797-9630-42ed-9fa1-b594e198bed8 req-e7a40d13-55e0-46b8-8e6b-017247cff922 service nova] Creating event network-vif-plugged:7b29c6e7-c1ba-4983-ab04-3db1251a4a72 for instance 27f777b2-7bd2-46fa-bd38-e601e5a904a7 on hv-cinder-80403 Nov 22 10:36:11.110781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-130de797-9630-42ed-9fa1-b594e198bed8 req-e7a40d13-55e0-46b8-8e6b-017247cff922 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035609 Nov 22 10:36:11.111621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 118/226] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:11.200185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5dca341e-c059-478e-bad8-bb7252d1bd83 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28050 microversion: 2.1 time: 0.151138 Nov 22 10:36:11.200953 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 109/227] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:11 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28050 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:11.868559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:11.869289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:11.876085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.876539 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.877327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.877759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.969183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:11.969942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:11.978877 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.979338 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:11.980156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:11.980593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.017686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:12.026127 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-be3c71cf-609c-4c9b-9e0e-3e3de6e77f20 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.162302 Nov 22 10:36:12.026806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 119/228] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:11 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:12.058642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:12.059823 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:12.065867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.066315 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.067173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.067598 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.125469 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:12.133595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7d89fd69-a841-4439-b2ad-fa999f27b2b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1497 microversion: 2.1 time: 0.168512 Nov 22 10:36:12.134315 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 110/229] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:11 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:12.147392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:12.147392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:12.148032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.148487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.149283 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.150071 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.293805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:12.301623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-570e7fb0-3ee4-4b56-8dea-3cc12840ded1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.166252 Nov 22 10:36:12.302417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 111/230] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:12 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:12.307600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:12.308563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:12.314643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.315087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:12.315934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:12.316366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:14.910583 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f6e3f322-5fa4-4a8a-91ea-d0f5b3e2bf9e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 2.855509 Nov 22 10:36:14.911254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 120/231] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:12 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 2857 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:36:14.916420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:14.917391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:14.924987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:14.925430 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:14.926242 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:14.926671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:14.956163 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9876b808-e649-4fb3-9c8e-b5c9cefeb236 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28237 microversion: 2.1 time: 2.652303 Nov 22 10:36:14.956837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 112/232] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:12 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28237 bytes in 2654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:14.969938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:14.970660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:14.978205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:14.978578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:14.979435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:14.979912 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.109897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:15.118196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-33610182-f382-4d2b-bcd1-e029f6cda911 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.205719 Nov 22 10:36:15.118778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 121/233] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:14 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:15.161922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:15.170328 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bc1d5e4c-f830-43f8-8764-de6d3f8bb43f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1318 microversion: 2.1 time: 0.211805 Nov 22 10:36:15.170847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 113/234] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:14 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:15.389541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:15.390147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:15.396734 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.397184 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.397959 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.398382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.431276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:36:15.530103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ea766418-d99e-4956-ad80-dc0a08962e20 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 204 len: 0 microversion: 2.1 time: 0.144804 Nov 22 10:36:15.530729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 122/235] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:36:15 2021] DELETE /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:36:15.539158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:15.539920 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:15.547099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.547541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.548354 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.548776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.693570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:15.701367 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e8373cc3-af5b-4dd2-b821-e8e57eafea32 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1503 microversion: 2.1 time: 0.166016 Nov 22 10:36:15.701943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 114/236] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:15 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:15.924143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:15.925256 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:15.932125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.932658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.933595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.934019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.968661 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:15.969621 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:15.976305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.977122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:15.977929 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:15.978356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.036463 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a3862246-98d7-4ef8-bff3-8bdbe9a2984e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.116744 Nov 22 10:36:16.039721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 123/237] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:15 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:16.084191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-820bc306-36aa-4439-ac37-c2833806d742 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28237 microversion: 2.1 time: 0.119003 Nov 22 10:36:16.084839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 115/238] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:15 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:16.136777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:16.137726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:16.145336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.145842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.147219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.147683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.188457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:16.189176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:16.196032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.196473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.197260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.197735 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.353448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:16.362915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-254042ca-d254-4393-b8eb-0c4fe48398e0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.230673 Nov 22 10:36:16.365968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 124/239] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:16 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:16.404855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:16.415538 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fd9298bd-9167-49d8-892f-439775d6e1d0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1509 microversion: 2.1 time: 0.231379 Nov 22 10:36:16.416186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 116/240] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:16 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:16.725245 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:16.725998 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:16.736444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.738316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.739620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:16.740236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:16.942359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:16.950706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f8935d8c-e920-407b-8d2f-b3e399931d0d tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1503 microversion: 2.1 time: 0.235047 Nov 22 10:36:16.951397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 125/241] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:16 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:17.049555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:17.050667 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:17.063310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.064208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.065507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.065939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.096439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:17.097659 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:17.105180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.105642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.106527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.107001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.136617 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-07d7426e-e8d8-426e-8073-208d8e164ff8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.090614 Nov 22 10:36:17.137446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 117/242] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:17 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:17.189524 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fcdaaefc-2e9e-4251-80f7-4082db0af782 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28237 microversion: 2.1 time: 0.096617 Nov 22 10:36:17.190094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 126/243] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:17 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:17.385453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:17.386155 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:17.393658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.394107 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.394900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.395337 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.544356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:17.553042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-079ad9f3-8061-4915-8afb-933489ba6708 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.171917 Nov 22 10:36:17.553746 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 118/244] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:17 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:17.849147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41463a4b-5ce6-4070-a74d-b361f22b918c"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:17.851226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:17.860974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.861416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.862202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.862625 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.971846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:17.972533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:17.982120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.983836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:17.984253 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:17.985002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.172236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b35c73f1-506d-483f-b6e0-d0da983d209f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327784 Nov 22 10:36:18.173108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 127/245] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:36:17 2021] POST /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:18.194558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:18.196308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:18.206190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.206798 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.208471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.209074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.241081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:18.256873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8ddea523-f7a8-475a-ba71-87eaf99e05bf tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 200 len: 1503 microversion: 2.1 time: 0.289262 Nov 22 10:36:18.259834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 119/246] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:17 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:18.277485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:18.283465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:18.292610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.293493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.294456 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.295025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.302246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-789434dd-ae3d-4e38-b03b-cfc2de62b298 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.126812 Nov 22 10:36:18.303645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 128/247] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:18 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:18.396876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d6a8b1d2-07f4-4ba9-903f-5668e8ef84a9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28237 microversion: 2.1 time: 0.131623 Nov 22 10:36:18.397583 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 120/248] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:18 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28237 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:18.458820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-6d3df3b7-4b54-4118-abc3-75dc3e3b6426 req-59b7377a-4757-41da-ab58-56171194a62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b", "name": "network-vif-deleted", "tag": "6d52f987-a868-4d8b-868b-4eda9ec40635"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:18.460541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:18.460541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:18.470814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6d3df3b7-4b54-4118-abc3-75dc3e3b6426 req-59b7377a-4757-41da-ab58-56171194a62a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.471399 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6d3df3b7-4b54-4118-abc3-75dc3e3b6426 req-59b7377a-4757-41da-ab58-56171194a62a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.498571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-6d3df3b7-4b54-4118-abc3-75dc3e3b6426 req-59b7377a-4757-41da-ab58-56171194a62a service nova] Creating event network-vif-deleted:6d52f987-a868-4d8b-868b-4eda9ec40635 for instance 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b on hv-cinder-80403 Nov 22 10:36:18.503813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-6d3df3b7-4b54-4118-abc3-75dc3e3b6426 req-59b7377a-4757-41da-ab58-56171194a62a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048931 Nov 22 10:36:18.504754 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 129/249] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:18.571729 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:18.572608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:18.585283 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.585737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.586651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:18.587751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:18.754009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:18.762247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-28b22817-851a-4032-a0ba-d27d873a56ab tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.194990 Nov 22 10:36:18.762863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 121/250] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:18 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:19.280618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:19.282487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:19.289188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.289681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.290482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.290916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.305487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] HTTP exception thrown: Instance 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b could not be found. Nov 22 10:36:19.306078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Returning 404 to user: Instance 1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:36:19.306988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8eb50dd0-a168-4600-8fbe-fa0b101463fb tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b" status: 404 len: 111 microversion: 2.1 time: 0.032383 Nov 22 10:36:19.321542 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 130/251] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:19 2021] GET /compute/v2.1/servers/1f2ecfd7-c14d-49b2-ad3d-31c3de5b4b4b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:36:19.322176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:19.323260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:19.330524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.331386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.332472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.333138 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.409417 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:19.410375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:19.410652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9e35c8f5-5dde-47aa-8bf3-2ac4a861d4f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 28661 microversion: 2.20 time: 0.099410 Nov 22 10:36:19.412047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 122/252] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:19 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 28661 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:19.417046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.417503 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.418246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.418695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.433360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1439317972", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "75fe944d-7f58-47aa-b60a-343caa9b99aa"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:19.490751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] validate_networks() for [('75fe944d-7f58-47aa-b60a-343caa9b99aa', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:36:19.520280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ca130b8d-fb01-4942-b5a3-3c88387782d3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28528 microversion: 2.1 time: 0.114760 Nov 22 10:36:19.520904 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 131/253] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:19 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28528 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:19.781178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:19.782149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:19.789600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.790069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.790849 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.791755 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.890128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:36:19.890567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:36:19.891084 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:36:19.891487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:36:19.891904 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:36:19.900807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.901313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.902129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:19.902543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:19.919843 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Getting quotas for project 4aa86d766a954554b6dc79984ed36bd5. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:36:19.924202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Getting quotas for user da06abf9d3ee47fb803c8fcc065d54af and project 4aa86d766a954554b6dc79984ed36bd5. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:36:19.936045 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:36:19.938506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:36:19.961450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:19.969068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-92debae1-70c0-4de1-96c3-6ea28843bc01 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.193050 Nov 22 10:36:19.969698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 132/254] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:19 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:19.986902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-47a38bf4-3798-4243-a719-e7a3915bd045 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558406 Nov 22 10:36:19.987591 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 123/255] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:36:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 10:36:19.997705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8a904227-28c3-41bc-88a9-9918a53ce310 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:19.998308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8a904227-28c3-41bc-88a9-9918a53ce310 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:20.049851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8a904227-28c3-41bc-88a9-9918a53ce310 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:20.057201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8a904227-28c3-41bc-88a9-9918a53ce310 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1214 microversion: 2.1 time: 0.063230 Nov 22 10:36:20.057784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 133/256] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:19 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:20.422620 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:20.423865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:20.430889 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:20.431371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:20.432339 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:20.432771 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:20.532732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:20.534029 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:20.542350 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ae8aca4b-1791-4dcb-af95-c0573c97b915 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 29205 microversion: 2.20 time: 0.123086 Nov 22 10:36:20.543532 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:20.544071 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 124/257] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:20 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 29205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:20.547372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:20.548269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:20.548714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:20.615725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-dc77e3a5-7897-468f-943f-79a0243e4050 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28528 microversion: 2.1 time: 0.085822 Nov 22 10:36:20.617284 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 134/258] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:20 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28528 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:20.987429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:20.988174 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:21.002824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.003626 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.004820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.005414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.076292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:21.077952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:21.088657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.089371 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.090530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.091105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.222188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:21.232506 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a2322211-2fb1-44fc-98c6-f6980597f4dc tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1274 microversion: 2.1 time: 0.161210 Nov 22 10:36:21.233469 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 135/259] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:21 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:21.444690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:21.453915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2166f3da-3ec1-49fb-b51e-8e85d2f83f88 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.471066 Nov 22 10:36:21.454520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 125/260] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:20 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:21.554882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:21.555957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:21.564502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.565238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.566208 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.567117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.628774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:21.629736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:21.641320 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.641774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.644766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:21.645208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:21.672550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-af5a0d6b-a1d5-4411-9ddf-4ddc3eae8ca4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 30299 microversion: 2.20 time: 0.121413 Nov 22 10:36:21.673219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 136/261] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:21 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 30299 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:21.752570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-03250ab6-1463-4c25-addd-481e0431a5ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28696 microversion: 2.1 time: 0.127708 Nov 22 10:36:21.757749 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 126/262] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:21 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28696 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:22.260158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:22.260944 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:22.268177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.268626 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.269412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.269842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.474400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:22.475978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:22.485438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.486434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.487609 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.488443 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.504895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:22.515965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-84f9d5bd-5eb7-4e51-a85a-6ac0ec50712e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.260246 Nov 22 10:36:22.517529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 137/263] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:22 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:22.686195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:22.687450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:22.697850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.698677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.704789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.704789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.759023 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:22.776012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5b51406f-b12d-49e0-8625-2f54250a95f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.305957 Nov 22 10:36:22.777015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 127/264] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:22 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:22.781884 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:22.782809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:22.791490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.792550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.793784 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.795637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:22.816098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f7078832-856f-438f-9db7-48965134f550 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 31378 microversion: 2.20 time: 0.131009 Nov 22 10:36:22.817115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 138/265] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:22 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 31378 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:22.887586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-06924ea4-f3d3-4900-ad1f-8211fd2ae7f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28696 microversion: 2.1 time: 0.107512 Nov 22 10:36:22.888851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 128/266] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:22 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28696 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:22.988508 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-52b52441-f720-435e-8b0e-348d63192b4f req-dbc3d077-fd26-4390-9057-06526eae1f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c524b47-d906-432d-989d-7da4bb3cf70c", "tag": "5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:22.990321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:22.990321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:22.998514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-52b52441-f720-435e-8b0e-348d63192b4f req-dbc3d077-fd26-4390-9057-06526eae1f13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:22.998964 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-52b52441-f720-435e-8b0e-348d63192b4f req-dbc3d077-fd26-4390-9057-06526eae1f13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.013823 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-52b52441-f720-435e-8b0e-348d63192b4f req-dbc3d077-fd26-4390-9057-06526eae1f13 service nova] Creating event network-changed:5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e for instance 2c524b47-d906-432d-989d-7da4bb3cf70c on hv-cinder-80403 Nov 22 10:36:23.018763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-52b52441-f720-435e-8b0e-348d63192b4f req-dbc3d077-fd26-4390-9057-06526eae1f13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035288 Nov 22 10:36:23.019370 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 139/267] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:23.535654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:23.536398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:23.545820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.546557 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.547969 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.548737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.761934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:23.773800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3c6ed6a0-4c3a-41cf-bf04-e917814cf985 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.244011 Nov 22 10:36:23.774901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 129/268] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:23 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:23.794953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:23.795471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:23.811335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.812101 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.813058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.813618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.836584 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:23.840845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:23.874068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.874818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:23.880893 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:23.881724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:24.004399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-819ecfc5-ce4e-46e9-a9f3-71d9d5ab9e88 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 32387 microversion: 2.20 time: 0.177448 Nov 22 10:36:24.005388 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 130/269] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:23 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 32387 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:24.011772 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:24.013089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:24.020572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:24.021566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:24.024182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:24.025265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:24.171546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ba6f2068-da5e-4317-be00-8fa4b2d3bc5f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28696 microversion: 2.1 time: 0.164123 Nov 22 10:36:24.173824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 131/270] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:24 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:24.406759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:24.422156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c0901758-fd67-4669-8af3-63c1a5b2e04a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.632751 Nov 22 10:36:24.423052 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 140/271] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:23 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:24.794048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:24.794916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:24.804155 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:24.808503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:24.809421 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:24.809864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:24.983601 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:24.991266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9298013b-78c0-4420-8c8a-adff2363ea70 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.202079 Nov 22 10:36:24.991876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 132/272] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:24 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:25.019020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:25.020099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:25.027864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.028803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.029715 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.030333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.116812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-458b653c-abf7-4112-be33-145f4fc00bbd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 32932 microversion: 2.20 time: 0.101397 Nov 22 10:36:25.118606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 141/273] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:25 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 32932 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:25.185281 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:25.186781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:25.194150 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.194716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.195586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.196272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.272037 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-96819a74-3f5b-4798-a144-7241d12e613a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28696 microversion: 2.1 time: 0.090836 Nov 22 10:36:25.273217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 133/274] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:25 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28696 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:25.442910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:25.443578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:25.451683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.452137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.453163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:25.453605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:25.622394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:25.630375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f8b5e978-6696-41f5-a6bb-3341c2107e46 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.192277 Nov 22 10:36:25.631157 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 142/275] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:25 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:26.009889 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:26.010651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:26.024475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1770369819", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "1739dec4-235e-4240-8471-290e5b4cd168"}]}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:26.026190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.026651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.027454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.027930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.102487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] validate_networks() for [('1739dec4-235e-4240-8471-290e5b4cd168', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:36:26.388574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:26.399768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cb204d45-ba55-4081-92a9-86015db762df tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.391770 Nov 22 10:36:26.407994 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 134/276] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:26 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:26.410211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:26.417324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:26.432119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.432771 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.434035 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.434865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.534548 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3cacd555-41d2-492d-99dd-3db74bea0a5f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 33758 microversion: 2.20 time: 0.131849 Nov 22 10:36:26.535514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 135/277] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:26 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 33758 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:26.541135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:26.542673 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:26.558197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.559355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.560610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.561282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.675200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5c1eb48d-0b44-4ca2-9721-e6972d54d550 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 28696 microversion: 2.1 time: 0.138038 Nov 22 10:36:26.675977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 136/278] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:26 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 28696 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:26.683597 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:26.684337 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:26.699362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.700446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.701415 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.701853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.922109 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:36:26.922527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:36:26.923000 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:36:26.923414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:36:26.923861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:36:26.947620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.948181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.948869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:26.949304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:26.957660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:26.970826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-27ceab9a-1eb4-4d09-aabd-7548ad8df62e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.293612 Nov 22 10:36:26.971758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 137/279] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:26 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:26.996258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:36:27.000624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for user d68748d566954625ac4a353c2a08b253 and project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:36:27.018584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:36:27.025499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:36:27.113913 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2ce11c6d-f5e6-4b96-ae59-bb0270c575e8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.091215 Nov 22 10:36:27.115993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 143/280] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:36:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 10:36:27.127369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ab5f5e9c-ea13-4127-af64-498c72b419e4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:27.128383 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ab5f5e9c-ea13-4127-af64-498c72b419e4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:27.224409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ab5f5e9c-ea13-4127-af64-498c72b419e4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:27.240431 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ab5f5e9c-ea13-4127-af64-498c72b419e4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1218 microversion: 2.1 time: 0.117610 Nov 22 10:36:27.241546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 138/281] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:27 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:27.424502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:27.427190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:27.435858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.437392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.438821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.439494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.548860 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:27.550489 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:27.563137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.563575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.564611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.565406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.688543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b6e80dda-ba1d-4cf3-b94c-0bc435a4d8cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 34394 microversion: 2.20 time: 0.145051 Nov 22 10:36:27.695859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:27.704318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 139/282] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:27 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 34394 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:36:27.705732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-145c0e9e-4ea7-4b0e-8588-dc2e490fd5b3 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.290789 Nov 22 10:36:27.717084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 144/283] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:27 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:27.741689 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:27.742799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:27.756292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.757032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.757986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:27.758565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:27.866207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6357cd6b-a124-4dbb-87c1-2c9cea6a77d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 29773 microversion: 2.1 time: 0.159935 Nov 22 10:36:27.867072 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 140/284] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:27 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 29773 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:27.987850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:27.988489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:28.006686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.007144 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.008133 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.008555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.256613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:28.260068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:28.266641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-490f52e2-3b59-4cf1-a487-78d3f0629b32 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.282750 Nov 22 10:36:28.277002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 145/285] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:27 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:28.277231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:28.289408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.289858 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.290654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.291120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.382834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:28.396042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cbf66c69-c05f-4e2a-b776-c62283e118a5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1270 microversion: 2.1 time: 0.141068 Nov 22 10:36:28.397991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 141/286] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:28 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:28.724593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:28.725696 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:28.748781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.749251 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.753240 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.753781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.758750 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:28.761358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:28.781853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.785351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.786935 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.787549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.930479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0ae4301a-7384-4635-8c46-9f40cbd140cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 34932 microversion: 2.20 time: 0.175380 Nov 22 10:36:28.931828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 142/287] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:28 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 34932 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:28.939201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:28.949698 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:28.971076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.975521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:28.975977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:28.977257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.094088 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5b9f2bc0-72e4-4f36-a7a7-01dbde9654d9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 31008 microversion: 2.1 time: 0.159765 Nov 22 10:36:29.094924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 143/288] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:28 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 31008 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:29.213648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:29.230325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-dea48219-6063-400b-a376-c5d14ffc37e9 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.509688 Nov 22 10:36:29.232314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 146/289] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:28 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:29.288487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:29.289868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:29.311452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.313428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.315702 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.319837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.419143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:29.419871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:29.431332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.431867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.432861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.436474 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.582836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:29.590486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9ac53d50-9ebf-4b4b-b86c-f8086d39f097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1276 microversion: 2.1 time: 0.177298 Nov 22 10:36:29.592255 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 147/290] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:29 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:29.597141 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-31b1acf7-5e5d-485e-8cd0-8df72f6650aa req-855a5e64-5b74-49d8-9354-cc6dc14234ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c524b47-d906-432d-989d-7da4bb3cf70c", "name": "network-vif-plugged", "status": "completed", "tag": "5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:29.599096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:29.599096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:29.608908 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-31b1acf7-5e5d-485e-8cd0-8df72f6650aa req-855a5e64-5b74-49d8-9354-cc6dc14234ff service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.609903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-31b1acf7-5e5d-485e-8cd0-8df72f6650aa req-855a5e64-5b74-49d8-9354-cc6dc14234ff service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.625102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-31b1acf7-5e5d-485e-8cd0-8df72f6650aa req-855a5e64-5b74-49d8-9354-cc6dc14234ff service nova] Creating event network-vif-plugged:5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e for instance 2c524b47-d906-432d-989d-7da4bb3cf70c on hv-cinder-80403 Nov 22 10:36:29.632317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-31b1acf7-5e5d-485e-8cd0-8df72f6650aa req-855a5e64-5b74-49d8-9354-cc6dc14234ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038379 Nov 22 10:36:29.634164 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 148/291] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:29.728965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:29.750116 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e93742c5-53d6-4821-8937-467f4b9e0fa8 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.469968 Nov 22 10:36:29.760610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 144/292] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:29 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:29.945598 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:29.947227 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:29.956190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.960925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:29.962088 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:29.963192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.072733 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b03c0252-68a7-4006-9554-171afa8d881b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 35648 microversion: 2.20 time: 0.130437 Nov 22 10:36:30.076755 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 149/293] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:29 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 35648 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:30.108867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:30.110455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:30.127944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.136587 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.139477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.146257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.252674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:30.253615 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:30.279543 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.280108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.296243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.300381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.333687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-30c90f08-77dc-45a6-bce1-e05b19addf77 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 32164 microversion: 2.1 time: 0.230078 Nov 22 10:36:30.335544 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 145/294] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:30 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 32164 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:30.617779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:30.618869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:30.630008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.631172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.632262 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.632903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.817376 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:30.835503 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4611b4af-efb2-4839-9da3-a1be43b2c7c7 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.583781 Nov 22 10:36:30.837997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 150/295] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:30 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:30.850729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:30.852211 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:30.866015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.866843 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:30.868398 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:30.869564 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.042488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:31.052222 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-583fc9ec-80a7-46fa-b1f2-bfe637b13b06 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.443536 Nov 22 10:36:31.063599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 146/296] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:30 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:31.089569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:31.091244 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:31.100438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.101564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.102903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.103593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.245387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-91c8d056-e444-4cc2-8714-d7ed6c0867ad tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 36554 microversion: 2.20 time: 0.162160 Nov 22 10:36:31.248366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 147/297] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:31 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 36554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:36:31.349999 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:31.351328 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:31.372244 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.374439 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.377923 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.378566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.457650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:31.473808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bb71723b-a2f2-49df-9cd6-ee7d9e5990f9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.633300 Nov 22 10:36:31.486193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 151/298] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:30 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:31.556561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-561ae345-1b44-4636-98ac-bebb7a14855b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 33223 microversion: 2.1 time: 0.211301 Nov 22 10:36:31.558141 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 148/299] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:31 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 33223 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:31.856918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:31.857700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:31.873163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.874152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:31.875643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:31.876507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.071152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:32.072323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:32.082375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.083472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.084794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.085564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.347505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:32.367390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-25c6ab0e-c76f-4ec8-9591-6c0d8ce97486 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1314 microversion: 2.1 time: 0.510923 Nov 22 10:36:32.368902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 152/300] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:31 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:32.382465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:32.382465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:32.397979 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.398454 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.399252 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.399706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.509464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e650ffd7-6655-496b-a204-8e1b272501e6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 37123 microversion: 2.20 time: 0.136883 Nov 22 10:36:32.509464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 153/301] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:32 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 37123 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:32.520303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:32.526576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:32.537076 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.537999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.539455 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.540108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.730441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:32.738909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f95ffecc-0129-4e2f-b835-642bf0b58da6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.672048 Nov 22 10:36:32.739991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 149/302] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:32 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:32.769209 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:32.771925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:32.792760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.793725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.794864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.795847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.911021 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fd5b80fa-7be1-44ed-adbb-bed7b35798da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 33693 microversion: 2.1 time: 0.169399 Nov 22 10:36:32.911714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 150/303] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:32 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 33693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:32.917803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-30f8d5ba-eaba-4662-ab8b-34ad0a3b1a51 req-edcd50a7-4050-47f3-ae75-056a7e2e3959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7b7eca-3a44-4f4a-8674-03ae1147162c", "tag": "d31f72a4-3cfb-4149-a149-0083a7db96b0"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:32.927517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:32.927517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:36:32.941471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-30f8d5ba-eaba-4662-ab8b-34ad0a3b1a51 req-edcd50a7-4050-47f3-ae75-056a7e2e3959 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:32.944445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-30f8d5ba-eaba-4662-ab8b-34ad0a3b1a51 req-edcd50a7-4050-47f3-ae75-056a7e2e3959 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:32.975340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-30f8d5ba-eaba-4662-ab8b-34ad0a3b1a51 req-edcd50a7-4050-47f3-ae75-056a7e2e3959 service nova] Creating event network-changed:d31f72a4-3cfb-4149-a149-0083a7db96b0 for instance 2c7b7eca-3a44-4f4a-8674-03ae1147162c on hv-cinder-80403 Nov 22 10:36:32.985870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-30f8d5ba-eaba-4662-ab8b-34ad0a3b1a51 req-edcd50a7-4050-47f3-ae75-056a7e2e3959 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072521 Nov 22 10:36:32.986567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 151/304] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:33.168613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:33.186073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-78f618b9-ea82-4863-9ee1-eb7e92fea86e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1502 microversion: 2.1 time: 0.675274 Nov 22 10:36:33.187030 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 154/305] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:32 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:33.208378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c219dea-8aa3-4710-bbe8-a8dcb9793f44"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:33.209533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:33.221908 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.223243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.224691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.225806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.265460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] HTTP exception thrown: Cannot 'attach_volume' instance 60ede0be-83f5-416b-8ba7-216691a79cbc while it is in vm_state rescued Nov 22 10:36:33.266451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Returning 409 to user: Cannot 'attach_volume' instance 60ede0be-83f5-416b-8ba7-216691a79cbc while it is in vm_state rescued {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:36:33.267510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-76d3770e-9530-4a4d-989e-5604e6fdd6a6 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063959 Nov 22 10:36:33.268649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 152/306] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:36:33 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 22 10:36:33.282912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:33.284335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:33.295213 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.296481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.298146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.299294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.385635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:33.387015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:33.400924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.401274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.402128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.402571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.457299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c87041d4-404d-4804-b112-8b4a9c8eb662 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.181704 Nov 22 10:36:33.462444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 155/307] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:33 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:33.476754 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:33.477466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:33.500708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.505223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:33.510328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:33.511305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.375709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:34.389722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-37beab62-8c5f-4c5b-bb5a-b48486a8d570 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.925260 Nov 22 10:36:34.401396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 156/308] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:33 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:34.407584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:34.408941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:34.417002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.418105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.419204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.420313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.488687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:34.514694 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-43871fe5-7b30-4e6c-a30e-d20fbf63e4f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 38185 microversion: 2.20 time: 0.111461 Nov 22 10:36:34.521897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 157/309] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:34 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 38185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:34.525981 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0da88875-e518-45a9-bdc4-829b58c22021 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1499 microversion: 2.1 time: 1.145293 Nov 22 10:36:34.548987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 153/310] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:33 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1499 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:34.557097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:34.558767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:34.560702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:34.563140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:34.567250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.568111 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.569405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.570054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.592980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.593427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.594282 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:34.594709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:34.705244 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-38a8d3b4-abe2-42dd-81c3-660ddfc9afc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 34537 microversion: 2.1 time: 0.154529 Nov 22 10:36:34.706460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 154/311] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:34 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 34537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:35.351916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:35.352516 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:35.355804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:35.359549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.360061 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.360847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.361275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.369163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ff7d3da1-f8ab-4027-a3af-9fff20df1915 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.838130 Nov 22 10:36:35.369763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 158/312] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:34 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:35.395726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:36:35.408214 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:35.408935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:35.415630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.416261 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.418235 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.419177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.534228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cfa3f7dc-6ea9-4bb2-84f6-07578a027c9e tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 204 len: 0 microversion: 2.1 time: 0.189432 Nov 22 10:36:35.535566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 155/313] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:36:35 2021] DELETE /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 10:36:35.544063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:35.546423 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:35.563404 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.564134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.565224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.565958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.665931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-60f39a62-ce30-4ca7-ba11-e11c2097cc7f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 38185 microversion: 2.20 time: 0.128375 Nov 22 10:36:35.666932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 156/314] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:35 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 38185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:35.672451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:35.673177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:35.682255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.682843 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.683682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:35.684187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:35.980664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:35.988671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-318e0660-2077-432e-a391-790105917a8a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.584249 Nov 22 10:36:35.989269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 159/315] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:35 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:35.993955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:35.995224 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:36.001486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.001842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.002861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.003296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.078650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:36.086741 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f88c8efe-f1f8-48f5-bb25-cf91df467504 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1505 microversion: 2.1 time: 0.418150 Nov 22 10:36:36.087443 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 157/316] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:35 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:36.098748 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ce72fde6-c222-44e7-b92f-2239c1707171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 35704 microversion: 2.1 time: 0.108144 Nov 22 10:36:36.104048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 160/317] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:35 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 35704 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:36.386444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:36.387555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:36.397106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.397744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.398577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.399016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.580003 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:36.598489 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-147aac16-f075-47c2-b917-1c00bfdc387e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.215980 Nov 22 10:36:36.600704 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 158/318] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:36 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:36.678743 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:36.679776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:36.688989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.689683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.690776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.691629 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.810700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-222406fa-b908-46bb-9019-5d6cc4e2b416 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 200 len: 38328 microversion: 2.20 time: 0.135780 Nov 22 10:36:36.811689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 161/319] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:36 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 38328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:36:36.822272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:36.823070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:36.830638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.831058 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.832066 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:36.832665 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:36.859738 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-64e9e7d9-081a-4a9c-a5eb-a16ee05523c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/ips" status: 200 len: 148 microversion: 2.20 time: 0.041797 Nov 22 10:36:36.866273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 159/320] 10.222.0.46 () {60 vars in 1288 bytes} [Mon Nov 22 10:36:36 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:37.007742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:37.008744 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:37.024765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.025602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.027529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.028392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.107705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:37.109650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:37.125893 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.127511 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.129690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.130919 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.326432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:37.340929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e1a16589-f981-40f0-9b2f-baf32e11583b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.336649 Nov 22 10:36:37.353670 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 162/321] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:37 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:37.374896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:37.379623 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:37.390692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.391360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.392353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.392960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.478383 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:37.499597 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-394a8476-ee1d-4882-8cf9-6d6cf3a92391 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1505 microversion: 2.1 time: 0.398754 Nov 22 10:36:37.500701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 160/322] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:37 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:37.530154 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-26b31e88-de03-462d-b0f7-0ab661d26e98 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 36379 microversion: 2.1 time: 0.174816 Nov 22 10:36:37.531464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 163/323] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:37 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 36379 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:37.617428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:37.618376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:37.628604 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.629363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.630267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:37.631645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:37.813507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:37.825573 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1b7088d6-509d-4058-8fa4-e45a993501b9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.211866 Nov 22 10:36:37.826450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 161/324] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:37 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:38.361516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:38.362834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:38.376050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.376390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.377291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.377716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.517203 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:38.518123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:38.528891 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.529490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.530362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.537754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.790016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:38.818305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d384279c-b2ce-46a2-99b9-616c7af95a8b tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1463 microversion: 2.1 time: 0.304978 Nov 22 10:36:38.819550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 162/325] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:38 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1463 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:38.834357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:38.835526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:38.847600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.848895 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.849743 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.850172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.895431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:38.912073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-303eac82-47cf-4af4-9012-d733dcfb2c65 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.554744 Nov 22 10:36:38.922182 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 164/326] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:38 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:38.923079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-b6bf3f84-1591-4bf1-a9f5-9bcb716dba96 req-7e8a75b3-74c9-4929-a9e8-877d6ae1ae60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c524b47-d906-432d-989d-7da4bb3cf70c", "name": "network-vif-deleted", "tag": "5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:38.925172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:38.925172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:38.935104 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b6bf3f84-1591-4bf1-a9f5-9bcb716dba96 req-7e8a75b3-74c9-4929-a9e8-877d6ae1ae60 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.935637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b6bf3f84-1591-4bf1-a9f5-9bcb716dba96 req-7e8a75b3-74c9-4929-a9e8-877d6ae1ae60 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.949437 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-b6bf3f84-1591-4bf1-a9f5-9bcb716dba96 req-7e8a75b3-74c9-4929-a9e8-877d6ae1ae60 service nova] Creating event network-vif-deleted:5f7ff9dc-3f50-4fd6-9c87-753e92d8e62e for instance 2c524b47-d906-432d-989d-7da4bb3cf70c on hv-cinder-80403 Nov 22 10:36:38.954871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-b6bf3f84-1591-4bf1-a9f5-9bcb716dba96 req-7e8a75b3-74c9-4929-a9e8-877d6ae1ae60 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040207 Nov 22 10:36:38.955971 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 165/327] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:38.962306 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:38.963433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:38.978527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.979159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:38.980582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:38.981174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:39.177681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:39.185689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4fd54bea-6447-41f5-95d1-87ccb7c4871e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.228208 Nov 22 10:36:39.186282 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 166/328] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:38 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:39.362522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Action: 'create', calling method: .version_select at 0x7f1a59d8e0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1099595075"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:39.384078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:36:39.387803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for user 13f1a43025414b4098ee39db391d525b and project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:36:39.512723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:36:39.516643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for user 13f1a43025414b4098ee39db391d525b and project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:36:39.530669 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-73523ec6-533a-4db4-b849-0baa47e317d9 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.343344 Nov 22 10:36:39.531328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 167/329] 10.222.0.46 () {60 vars in 1157 bytes} [Mon Nov 22 10:36:39 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:39.836283 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:39.837053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:39.850652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:39.851807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:39.852728 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:39.853235 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:39.938906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:39.949638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4b8834c8-096e-4dc6-be69-9aabe6dbbf57 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1299 microversion: 2.1 time: 0.117754 Nov 22 10:36:39.952187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 168/330] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:39 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:39.959416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:39.960540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:39.967316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:39.968847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:39.969845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:39.971198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:40.159988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:40.173297 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b5218f17-aa41-4a7b-9fba-5b8229fa9702 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.217636 Nov 22 10:36:40.183123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 169/331] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:39 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:40.203106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:40.203845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:40.211646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:40.212341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:40.213390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:40.214060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:40.412535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:40.428335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2d232f65-aec4-4737-972f-96d023b84988 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.223462 Nov 22 10:36:40.432049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 170/332] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:40 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:40.970547 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:40.971347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:40.984948 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:40.985555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:40.986449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:40.988579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.032525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-42b84445-c2cd-4845-be6c-8efbc98f0506 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 38173 microversion: 2.1 time: 2.211401 Nov 22 10:36:41.033742 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 163/333] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:38 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 38173 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:36:41.142530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da06abf9d3ee47fb803c8fcc065d54af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa86d766a954554b6dc79984ed36bd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:41.151761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4bc8900d-307e-48e2-a359-9edbd089cfce tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 200 len: 1299 microversion: 2.1 time: 0.186198 Nov 22 10:36:41.152423 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 171/334] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:40 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:41.193154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:41.194154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:41.206818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.207471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.209303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.210488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.431414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:41.434947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:41.435581 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:41.445609 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.446054 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.447262 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5ff2e4ba-4531-4eb6-9e7e-c96915292fef tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1510 microversion: 2.1 time: 0.257744 Nov 22 10:36:41.450934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 164/335] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:41 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1510 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:41.452349 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.452789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.465168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:41.466030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:41.485443 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.485924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.486728 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:41.494341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:41.518195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lazy-loading 'flavor' on Instance uuid 640f234a-3202-4c2c-97b9-32b4048c9ef3 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:36:41.832259 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:41.851415 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c20463bb-afdb-4072-b528-2911914285e6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.396622 Nov 22 10:36:41.863472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 165/336] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:41 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:42.047425 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:42.051609 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:42.061914 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f44ecb77-417a-4352-9713-a466c298892b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 202 len: 0 microversion: 2.20 time: 0.630557 Nov 22 10:36:42.062977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 172/337] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:36:41 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 22 10:36:42.069287 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.069915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.071532 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.072177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:42.072765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.073103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:42.079945 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.080494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.081379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.082037 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.204298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bee33d6c-1d77-4455-a232-63b332406eda tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 38173 microversion: 2.1 time: 0.162897 Nov 22 10:36:42.204996 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 166/338] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:42 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 38173 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:42.212095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:42.213301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] [instance: 2c524b47-d906-432d-989d-7da4bb3cf70c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:42.222161 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.222832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.224421 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.225079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.244091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:42.246786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] HTTP exception thrown: Instance 2c524b47-d906-432d-989d-7da4bb3cf70c could not be found. Nov 22 10:36:42.248480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] Returning 404 to user: Instance 2c524b47-d906-432d-989d-7da4bb3cf70c could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:36:42.249490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b77f328d-e13e-4c6e-9e51-6659f5b1e192 tempest-VolumesActionsTest-435086940 tempest-VolumesActionsTest-435086940-project] 10.222.0.46 "GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c" status: 404 len: 111 microversion: 2.1 time: 0.043147 Nov 22 10:36:42.253362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:42.253552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 167/339] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:42 2021] GET /compute/v2.1/servers/2c524b47-d906-432d-989d-7da4bb3cf70c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:36:42.255337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:42.256920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-55678055-17cf-4fde-afb8-82707a11242e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.189241 Nov 22 10:36:42.257667 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 173/340] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:42 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:42.471047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:42.471291 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:42.484366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.485089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.485898 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.486890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.657939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:42.665819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-61755178-d9a1-4ee7-9a6c-6893bbe5efa4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1516 microversion: 2.1 time: 0.203186 Nov 22 10:36:42.666402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 168/341] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:42 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:42.885609 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:42.885609 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:42.899777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.900524 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:42.901811 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:42.902529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.220060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:43.220060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:43.226333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.226954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.228581 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.229476 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.241162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:43.252955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-103384e1-7f4c-49de-923d-cc4cc597a11b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.376645 Nov 22 10:36:43.254489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 174/342] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:42 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:43.278254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:43.279160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:43.286059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.286518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.287328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.287790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.330311 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b62053a5-57d3-4121-b3ff-f5443bfa240d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 200 len: 38302 microversion: 2.1 time: 0.117139 Nov 22 10:36:43.334719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 169/343] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:43 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 38302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:36:43.345141 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:43.345736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:43.353496 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.354095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.354779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:43.355217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:43.381179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bbd653dd-6694-4265-87d1-d731ea0a8e46 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/ips" status: 200 len: 145 microversion: 2.1 time: 0.040242 Nov 22 10:36:43.381798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 170/344] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:36:43 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:36:43.444773 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:43.454293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:43.455827 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:43.457023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-99253f88-867e-48bc-ba00-f245a6c3513b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.184358 Nov 22 10:36:43.457607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 175/345] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:43 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:44.273551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:44.274966 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:44.280799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:44.281508 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:44.289612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.290057 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.291217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.291604 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.292161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.292488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.293462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.294164 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.534619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:44.543039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4c4f8c8f-07d3-48c8-afbe-2ba0c606233f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1516 microversion: 2.1 time: 0.267182 Nov 22 10:36:44.543646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 176/346] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:44 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1516 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:44.546805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:44.550172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:44.551023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:44.555195 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f13bd464-aac5-412f-a670-17de26bfeee7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.286364 Nov 22 10:36:44.555818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 171/347] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:44 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:44.558152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.558594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.559407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.560009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.560566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e251c61e-927a-46df-8dff-f9dc8c0df9c2"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:44.561672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:44.567883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.568335 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.569113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:44.569540 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:44.699475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:44.707730 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:44.709268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:44.710449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-91363cf1-8d1a-4ae5-ba59-1356ca2220f5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.164657 Nov 22 10:36:44.711011 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 177/348] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:44 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:45.573638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:45.574367 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:45.587859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:45.588335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:45.589166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:45.589589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:45.733399 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:45.740847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-77ccc84b-fce7-480a-802b-bf9275116033 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.171443 Nov 22 10:36:45.741443 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 178/349] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:45 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:45.746595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:45.747254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:45.753650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:45.754099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:45.754915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:45.755438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:45.889300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:45.897758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:45.899238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:45.900473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1ec6403f-1c38-4f92-937d-0ecdb9ed3afb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.158076 Nov 22 10:36:45.901039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 179/350] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:45 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:45.905459 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-eab1a42e-faf2-4b08-a825-68e9b11b76ec req-08d4cd5d-9b63-4935-bf48-1485eb744fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7b7eca-3a44-4f4a-8674-03ae1147162c", "name": "network-vif-plugged", "status": "completed", "tag": "d31f72a4-3cfb-4149-a149-0083a7db96b0"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:45.907049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:36:45.907049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:36:45.913961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-eab1a42e-faf2-4b08-a825-68e9b11b76ec req-08d4cd5d-9b63-4935-bf48-1485eb744fc1 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:45.914398 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-eab1a42e-faf2-4b08-a825-68e9b11b76ec req-08d4cd5d-9b63-4935-bf48-1485eb744fc1 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:45.925311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-eab1a42e-faf2-4b08-a825-68e9b11b76ec req-08d4cd5d-9b63-4935-bf48-1485eb744fc1 service nova] Creating event network-vif-plugged:d31f72a4-3cfb-4149-a149-0083a7db96b0 for instance 2c7b7eca-3a44-4f4a-8674-03ae1147162c on hv-cinder-80403 Nov 22 10:36:45.930058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-eab1a42e-faf2-4b08-a825-68e9b11b76ec req-08d4cd5d-9b63-4935-bf48-1485eb744fc1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027949 Nov 22 10:36:45.930637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 180/351] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:46.708651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e9f6d5c4-b864-4de0-8c61-2d67e5946ecc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.151507 Nov 22 10:36:46.709353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 172/352] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:36:44 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments => generated 194 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:46.761085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:46.761777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:46.775303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:46.775303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:46.775303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:46.775303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:46.920412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:46.921114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:46.929917 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:46.930661 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:46.931564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:46.932030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:46.986751 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:46.994919 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cfcb90d1-ded1-4434-961d-ac80446b55e5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.239070 Nov 22 10:36:46.995506 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 181/353] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:46 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:47.082554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:47.090935 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:47.092445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:47.093582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-64187c9c-08f9-45b7-82d0-c2ac0aba7275 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.178623 Nov 22 10:36:47.094184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 173/354] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:46 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:48.013425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:48.014424 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:48.023387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.023976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:48.025273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.025273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:48.111844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:48.112499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:48.119635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.120081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:48.120883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.121343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:48.197095 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:48.205595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3ba3ee52-b30c-4646-9eb1-a3c1b7c9cbba tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.196850 Nov 22 10:36:48.206270 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 182/355] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:48 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:48.292133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:48.304216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:48.306542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:48.307990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9ebf8fbf-3915-4f63-b308-43e2b4c25ab5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.200149 Nov 22 10:36:48.309048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 174/356] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:48 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:36:48.385163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "942f00c7-df16-4c92-869a-84638695f205"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:48.386294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:48.393976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.394407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:48.395203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:48.395746 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:49.222369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:49.222955 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:49.230368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:49.230904 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:49.231784 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:49.232224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:49.414296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:49.423966 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f392affd-b7d9-414e-b0e5-9c5db40163f3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.205083 Nov 22 10:36:49.424643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 175/357] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:49 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:49.431122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:49.432571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:49.440420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:49.440871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:49.441660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:49.442212 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:49.590919 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:49.599022 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:49.600896 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:49.602081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-963b2fd0-a022-44f4-beb6-9cd7542b1fc1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.176065 Nov 22 10:36:49.602894 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 176/358] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:49 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:50.443195 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:50.444044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:50.454302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:50.454758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:50.455561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:50.456131 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:50.614427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:50.624616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5235a52b-acea-4761-a8e8-1f415b37a748 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1318 microversion: 2.1 time: 0.187063 Nov 22 10:36:50.625753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 177/359] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:50 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:50.638040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:50.638954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:50.645809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:50.646529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:50.647514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:50.648022 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:50.805320 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:50.814434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:50.816042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:50.817598 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-adcbd4c9-c829-4bde-af9b-0013e17cb182 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.190675 Nov 22 10:36:50.818193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 178/360] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:50 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:51.643872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:51.645570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:51.654103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:51.654865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:51.656135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:51.656701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:51.813149 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:51.830080 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bb65af69-2864-4351-ac0c-1d2a4b6d0773 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1509 microversion: 2.1 time: 0.190896 Nov 22 10:36:51.842514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 179/361] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:51 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:36:51.847786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:51.848481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:51.856105 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:51.856558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:51.857346 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:51.857780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.004111 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:52.019929 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:52.022682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:52.025284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a56ed8f1-ca0c-4395-a5c8-b01833320bdc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.180388 Nov 22 10:36:52.026842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 180/362] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:51 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:52.043806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41463a4b-5ce6-4070-a74d-b361f22b918c"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:52.048336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:52.060047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.060975 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.062847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.064166 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.259881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Invalid volume: volume 41463a4b-5ce6-4070-a74d-b361f22b918c is already attached to instances: 27f777b2-7bd2-46fa-bd38-e601e5a904a7 Nov 22 10:36:52.260909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 400 to user: Invalid volume: volume 41463a4b-5ce6-4070-a74d-b361f22b918c is already attached to instances: 27f777b2-7bd2-46fa-bd38-e601e5a904a7 {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:36:52.263303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6c3c61f0-e2fa-43dd-b732-5ef50251f542 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.236399 Nov 22 10:36:52.265269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 181/363] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:36:52 2021] POST /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c/os-volume_attachments => generated 174 bytes in 239 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:36:52.371062 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:52.371645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:52.382087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.382568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.383371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.383846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.470960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bdf329cc-b68c-4c6d-a727-fa91b6909b0b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.089153 Nov 22 10:36:52.478438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 183/364] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:36:48 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments => generated 194 bytes in 4093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:52.575351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'services' on Instance uuid 27f777b2-7bd2-46fa-bd38-e601e5a904a7 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:36:52.732506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-10cf792e-e760-456c-b5eb-06bf71a64766 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments/41463a4b-5ce6-4070-a74d-b361f22b918c" status: 202 len: 0 microversion: 2.1 time: 0.364851 Nov 22 10:36:52.733349 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 182/365] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:36:52 2021] DELETE /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments/41463a4b-5ce6-4070-a74d-b361f22b918c => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:36:52.757702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:52.764347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:52.785181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.785181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.785181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:52.785181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:52.820597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-570293b5-577c-4aea-996c-aa717b64ea69 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082001 Nov 22 10:36:52.821040 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 184/366] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:52 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:53.045865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:53.046862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:53.053915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:53.054367 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:53.055179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:53.056073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:53.210997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:53.219554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:53.221103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:53.222275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2d650f9f-1f8b-4ac2-bf5e-9f66f7e83961 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.180842 Nov 22 10:36:53.222846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 183/367] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:53 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:53.833656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:53.835028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:53.841931 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:53.842362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:53.843456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:53.844170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:53.875843 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-76036d27-8917-408e-9106-56a940ae9e48 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Nov 22 10:36:53.876804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 185/368] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:53 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:54.245239 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:54.247694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:54.256317 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:54.257864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:54.259059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:54.259753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:54.458239 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:54.472167 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:54.475083 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:54.476656 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8bb4a3a1-8314-457f-97ed-b928273701ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.235463 Nov 22 10:36:54.478726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 184/369] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:54 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:54.888454 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:54.889969 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:54.896603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:54.897048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:54.897865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:54.898296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:54.938284 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-18dd1080-16ef-4d7f-a10b-eb77d973ef01 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053928 Nov 22 10:36:54.938884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 186/370] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:54 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:55.498129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:55.499135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:55.510873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.512323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.513814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.515143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.545714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:36:55.546933 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:55.558350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.559000 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.559917 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.560568 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.605786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lazy-loading 'flavor' on Instance uuid 60ede0be-83f5-416b-8ba7-216691a79cbc {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:36:55.736711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:55.755952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:55.761660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:55.767873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1b828090-a44d-4e20-a4c7-ec4ec7c44637 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.272679 Nov 22 10:36:55.779696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 185/371] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:55 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:55.814143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2c071cc8-cebb-4dbb-9df3-70cc11dc2b7f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action" status: 200 len: 32 microversion: 2.1 time: 0.274691 Nov 22 10:36:55.815646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 187/372] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:36:55 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:36:55.828610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:55.829250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:55.845863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.846632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.848033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.848766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.952324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:55.954512 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:55.966238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.966574 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:55.967507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:55.976874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:56.023406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d35f35b7-16a8-45cb-9ef3-51df0af31e14 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076438 Nov 22 10:36:56.024056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 188/373] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:55 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:36:56.181351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:56.191558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-03e4adbe-6b02-43d1-b228-01bc0619fbcd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.370063 Nov 22 10:36:56.203910 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 186/374] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:55 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:56.789809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:56.790656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:56.797414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:56.798220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:56.799313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:56.800036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:56.976296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:56.995050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:57.010462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:57.012205 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c0227732-8109-4a1a-9621-24d9b28c0e64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.226162 Nov 22 10:36:57.013267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 189/375] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:56 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:57.035179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:57.036810 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:57.048746 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:57.052796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:57.054432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:57.054980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:57.106855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0d891280-d7a8-4244-9a61-49a3fa675072 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075016 Nov 22 10:36:57.108643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 187/376] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:57 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:57.216894 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:57.217863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:57.229153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:57.230805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:57.232521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:57.234255 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:57.394290 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:57.403001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-210d5346-b126-4af7-b0d7-ced1fc610491 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.191704 Nov 22 10:36:57.404164 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 190/377] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:57 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:58.040340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:58.042279 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:58.049932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.050660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.051876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.052475 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.122785 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:58.129442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:58.146280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.150235 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.151120 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.151618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.265833 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0dee0e81-3ac4-436c-9e73-2dca3e24362f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143706 Nov 22 10:36:58.266955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 191/378] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:58 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:36:58.325356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:58.337376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:58.339231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:58.340336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6766b048-30ee-4e9c-8bf5-1142d0a0f936 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.312273 Nov 22 10:36:58.354621 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 188/379] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:58 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:58.420706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:58.422561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:58.432458 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.437093 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.440475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:58.443632 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:58.757326 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:58.771473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-46492aea-f292-4f26-a2d7-8f30a62d9dbd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.354440 Nov 22 10:36:58.772505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 192/380] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:58 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:36:59.279237 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:59.280257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:59.293966 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.294417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:59.297067 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.297536 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:59.345281 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a8de6698-ac9e-472a-80d8-77ed9982c2ca tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071276 Nov 22 10:36:59.345901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 189/381] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:36:59 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:36:59.363751 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:59.364999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:59.372411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.372866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:59.373663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.374267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:59.742415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:59.756630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:59.766329 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:36:59.770847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d30689b8-2c32-4771-892e-3959bca41b7e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.409010 Nov 22 10:36:59.780880 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 193/382] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:36:59 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:36:59.789735 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:36:59.790648 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:36:59.797095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.797815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:36:59.800586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:36:59.801275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:00.088428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:00.096857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6be779e4-f859-482e-b5b5-277104ce1726 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.310695 Nov 22 10:37:00.120914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 190/383] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:36:59 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:00.358066 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:00.359021 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:00.366396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:00.374143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:00.374831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:00.375277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:00.430473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-26a645cd-9d0a-4824-9563-4b2b23330de3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076124 Nov 22 10:37:00.431861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 194/384] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:00 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:00.789350 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:00.791027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:00.801907 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:00.805991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:00.807137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:00.807781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:01.114431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:01.115458 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:01.124100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:01.128310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:01.129467 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:01.130146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:01.185862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:01.235457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:01.248313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:01.249633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ba7d45df-d5cd-4aa5-a5c6-c25be7c7b6f8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.464072 Nov 22 10:37:01.270336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 191/385] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:00 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:01.413982 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:01.424244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-977c40f5-197e-446c-a295-413a17974e24 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.313559 Nov 22 10:37:01.436491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 195/386] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:01 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:01.443424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:01.444437 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:01.451251 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:01.451771 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:01.453104 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:01.453690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:01.500642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0917b7e6-64ea-4f03-a9df-3c4b26d5f172 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061457 Nov 22 10:37:01.501911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 192/387] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:01 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:02.282139 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:02.283960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:02.302397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.304315 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.308925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.310334 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.443834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:02.444854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:02.460449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.461440 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.462975 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.464230 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.656781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:02.674525 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:02.676239 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:02.677698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3b9e59e6-a8e6-476a-b131-627cba52f019 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.410996 Nov 22 10:37:02.702045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 196/388] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:02 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:02.719635 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:02.720954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:02.760703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.767747 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.771375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.772659 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.847293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4a9bf50b-81f7-4c93-8f5e-aaa5ad7856fc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144039 Nov 22 10:37:02.848323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 197/389] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:02 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:02.857170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3b2b7e26-eb9a-43e1-a33e-ae9157b301f9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:02.867274 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b2b7e26-eb9a-43e1-a33e-ae9157b301f9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:02.868183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b2b7e26-eb9a-43e1-a33e-ae9157b301f9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:02.917921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:02.943859 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6c0949f3-0859-48db-888d-eecd9e053b0b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.503534 Nov 22 10:37:02.974714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 193/390] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:02 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:03.012250 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3b2b7e26-eb9a-43e1-a33e-ae9157b301f9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Going to try to stop instance {{(pid=122858) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 10:37:03.123307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3b2b7e26-eb9a-43e1-a33e-ae9157b301f9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 202 len: 0 microversion: 2.1 time: 0.272778 Nov 22 10:37:03.124276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 198/391] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:37:02 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:37:03.138584 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:03.145390 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:03.171821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.179450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.181501 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.183783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.402190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:03.412600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-771937b2-6e74-420c-8b68-3403f179e57d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.281988 Nov 22 10:37:03.413201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 194/392] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:03 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:03.699632 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:03.700675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:03.714633 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.715071 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.716120 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.716717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.869907 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:03.871301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:03.882471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.884518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:03.887353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.889103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.889902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.902385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:03.903943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:03.905248 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-588bb05c-dc5c-4852-9721-b8777670ea6b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.211321 Nov 22 10:37:03.922870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 199/393] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:03 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:03.948414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-25d329e3-74fc-4426-bee0-6dbd3316c9d8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.089301 Nov 22 10:37:03.949542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 195/394] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:03 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:37:03.981314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:03.982580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:03.994955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.994955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:03.994955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:03.994955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:04.174658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-109151449", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "1739dec4-235e-4240-8471-290e5b4cd168"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:04.249835 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:04.264855 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-86c87e46-127a-4bbd-8af8-720e7a03b8d0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.288662 Nov 22 10:37:04.274999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 200/395] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:03 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:04.430761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:04.431743 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:04.444936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:04.446159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:04.450513 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:04.451484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:04.716375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:04.731288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5efe95ba-47ae-427d-b76a-c3b8654acc65 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.304285 Nov 22 10:37:04.745291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 201/396] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:04 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:04.929027 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:04.929789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:04.939293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:04.945014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:04.947136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:04.947808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:05.185560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:05.194068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:05.199884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:05.203184 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c14638de-d534-42f5-a1d6-42c9f04060ab tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.280181 Nov 22 10:37:05.214556 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 202/397] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:04 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:05.284393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:05.285511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:05.293618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:05.294085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:05.295038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:05.295839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:05.545241 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:05.560658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d974ca5c-04ee-45ef-b397-062cd0a2b377 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.281583 Nov 22 10:37:05.564446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 203/398] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:05 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:05.758037 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:05.762311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:05.793508 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:05.794449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:05.802086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:05.802918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:06.442979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] validate_networks() for [('1739dec4-235e-4240-8471-290e5b4cd168', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:37:06.634394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:06.654695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9f38ca71-8f04-4e6b-972f-73d5afc7ca27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.905721 Nov 22 10:37:06.656501 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 204/399] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:05 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:06.663621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:06.664588 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:06.731591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:06.732079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:06.732873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:06.733308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.375041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:07.394124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:07.398096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:07.404036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c2d5b6d2-9472-48c1-8d23-08803dd2e115 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.745864 Nov 22 10:37:07.406937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 205/400] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:06 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:07.418136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:07.420477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:07.430726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.439391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.440440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.441080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.749002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:37:07.750261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:37:07.750984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:37:07.751608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:37:07.752423 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:37:07.766750 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.767577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.769000 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.772357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.807564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:07.814527 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for user d68748d566954625ac4a353c2a08b253 and project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:07.831333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:37:07.834200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:37:07.835970 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:07.848930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-86da17bc-53e8-434a-8c89-4cc5d1ec9ce9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.439795 Nov 22 10:37:07.849579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 206/401] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:07 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:07.884808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:07.885505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:07.913878 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.914415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.915685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:07.924724 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:07.960120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7f223011-1b0a-4620-af7d-194c9af1f079 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.789035 Nov 22 10:37:07.963187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 196/402] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:37:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 3794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:37:07.984038 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e0d7f4e0-7b33-46cb-9870-9f085e8401f6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:07.986736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e0d7f4e0-7b33-46cb-9870-9f085e8401f6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:08.202721 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e0d7f4e0-7b33-46cb-9870-9f085e8401f6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:08.220025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e0d7f4e0-7b33-46cb-9870-9f085e8401f6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1217 microversion: 2.1 time: 0.249600 Nov 22 10:37:08.231276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 197/403] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:07 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1217 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:08.427558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:08.428223 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:08.440172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:08.440727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:08.441759 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:08.442214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:08.534085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:08.553329 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bf2e197b-889e-4644-b7a3-d015ea8927ba tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.701916 Nov 22 10:37:08.563186 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 207/404] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:07 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:08.867353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:08.868077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:08.881243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:08.881698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:08.882519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:08.882950 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:08.941226 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:08.988019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:09.004007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:09.005420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-74acab10-4f01-469e-b357-123e326200ff tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1742 microversion: 2.20 time: 0.584090 Nov 22 10:37:09.021847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 198/405] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:08 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1742 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:09.238079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:09.239072 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:09.259447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:09.264410 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:09.267371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:09.270822 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:09.459355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:09.474017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ef842d21-7987-40c2-a583-ab9359179340 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1213 microversion: 2.1 time: 0.239344 Nov 22 10:37:09.476106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 199/406] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:09 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:09.546569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:09.558117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e06e1c19-db51-4963-b6e4-09c3b6eb6212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.695328 Nov 22 10:37:09.570729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 208/407] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:08 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:09.582488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:09.583346 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:09.592093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:09.593808 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:09.595603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:09.596441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:09.940779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:09.956776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-dbfac55c-c6dc-497d-93db-6afea93cbd6b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.379836 Nov 22 10:37:09.958444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 200/408] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:09 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:10.033902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:10.038357 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:10.055308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.056434 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:10.057807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.059895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:10.495418 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:10.496448 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:10.505020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.506882 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:10.508392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.509365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:10.715574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:10.724171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ab06b196-dbfe-4990-8adb-a2da9ca476a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1275 microversion: 2.1 time: 0.233666 Nov 22 10:37:10.736777 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 201/409] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:10 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:10.742019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:10.747546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:10.754726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.756297 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:10.758313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:10.759114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:11.872784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:11.884094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:11.888313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:11.893339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-59c40982-a52f-4147-b3ff-588b4a2ec889 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1742 microversion: 2.20 time: 1.862595 Nov 22 10:37:11.894071 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 209/410] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:10 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1742 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:11.919597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:11.926412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:11.947328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:11.953420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:11.961788 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:11.964586 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:12.343243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:12.358483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b49a2c2b-cad0-4a93-a287-43e06b88a823 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 1.617849 Nov 22 10:37:12.359554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 202/411] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:10 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:12.372510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-fcb2e7db-6caf-41de-9c41-d08d0b603dcc req-0d1e49de-f477-4fd5-bafd-9453253db2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "name": "network-vif-plugged", "status": "completed", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:12.377846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:12.377846 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:37:12.396854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-fcb2e7db-6caf-41de-9c41-d08d0b603dcc req-0d1e49de-f477-4fd5-bafd-9453253db2f1 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:12.401369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-fcb2e7db-6caf-41de-9c41-d08d0b603dcc req-0d1e49de-f477-4fd5-bafd-9453253db2f1 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:12.439176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-fcb2e7db-6caf-41de-9c41-d08d0b603dcc req-0d1e49de-f477-4fd5-bafd-9453253db2f1 service nova] Creating event network-vif-plugged:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:37:12.465886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-fcb2e7db-6caf-41de-9c41-d08d0b603dcc req-0d1e49de-f477-4fd5-bafd-9453253db2f1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101815 Nov 22 10:37:12.466539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 203/412] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:12.495433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:12.504695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:12.524119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:12.524851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:12.525978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:12.526578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:13.228869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:13.260643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-34c8cfec-ff9e-4758-881b-bae2e40f5921 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 1.364588 Nov 22 10:37:13.279870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 210/413] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:11 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:13.287205 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:13.298853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:13.317738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:13.318192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:13.319038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:13.321856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:13.428942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:13.476384 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4a397bc5-e53c-4795-8466-57e5509a2b04 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.997049 Nov 22 10:37:13.485480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 204/414] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:12 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:13.498848 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:13.501692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:13.523348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:13.527961 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:13.529370 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:13.533447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:14.086404 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:14.099406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:14.103711 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:14.108921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7ea1c648-e824-4ee2-b01a-e5cf7f82a5a6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.836691 Nov 22 10:37:14.124813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 211/415] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:13 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:14.258982 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:14.267467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cdd57c84-debe-4ca9-ba3b-26cbba13debb tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.779804 Nov 22 10:37:14.289343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:14.290414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 205/416] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:13 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:14.292591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:14.309809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:14.315161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:14.316336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:14.322110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:14.514407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:14.517181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:14.538018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:14.538805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:14.557973 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:14.558895 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:15.355841 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:15.374138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b73c729e-c693-4598-8f77-15010816d019 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 1.085583 Nov 22 10:37:15.389172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 212/417] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:14 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:15.407495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-471970858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1099595075", "security_groups": [{"name": "tempest-secgroup-smoke-284482219"}], "networks": [{"uuid": "9f0551c7-6430-4845-aada-62dfaa2f8a11"}], "block_device_mapping_v2": [{"uuid": "dd5279d4-1219-4cf4-8f35-63e75557a9fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:15.439689 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:15.472768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-525c6f8d-577b-4197-b61c-bb542259cc38 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.973738 Nov 22 10:37:15.485387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 206/418] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:14 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:15.494553 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-d4aefbd1-e348-4493-b510-bcd9ae3a6746 req-560a0b23-7cb0-4b67-8cba-7b6c9859689d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef620a8a-291f-484a-aacb-17f63097f482", "tag": "8fcdd3ad-842b-4a16-9297-c14e81508bca"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:15.502513 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:15.502513 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:37:15.523862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-d4aefbd1-e348-4493-b510-bcd9ae3a6746 req-560a0b23-7cb0-4b67-8cba-7b6c9859689d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:15.525665 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-d4aefbd1-e348-4493-b510-bcd9ae3a6746 req-560a0b23-7cb0-4b67-8cba-7b6c9859689d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:15.558915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-d4aefbd1-e348-4493-b510-bcd9ae3a6746 req-560a0b23-7cb0-4b67-8cba-7b6c9859689d service nova] Creating event network-changed:8fcdd3ad-842b-4a16-9297-c14e81508bca for instance ef620a8a-291f-484a-aacb-17f63097f482 on hv-cinder-80403 Nov 22 10:37:15.575192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-d4aefbd1-e348-4493-b510-bcd9ae3a6746 req-560a0b23-7cb0-4b67-8cba-7b6c9859689d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096790 Nov 22 10:37:15.582561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 207/419] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:15.599433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:15.607523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:15.627387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:15.628916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:15.630365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:15.632190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:16.012037 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] validate_networks() for [('9f0551c7-6430-4845-aada-62dfaa2f8a11', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:37:16.990545 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:17.035321 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:17.043627 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:17.045740 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ed937945-07cc-4207-a64a-45b49a8330b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 1.453268 Nov 22 10:37:17.046902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 208/420] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:15 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:17.053582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:17.054650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:17.061790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.062614 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.063918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.064572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.668014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:37:17.669413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:37:17.670477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:37:17.671311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:37:17.672038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:37:17.693342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.694518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.698511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.700468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.740011 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:17.753415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Getting quotas for user 13f1a43025414b4098ee39db391d525b and project 48e14154c62a42a8b78c798e97aa89fb. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:17.791169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:17.803127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fb1ddacb-c03e-4455-b380-fae43f3d2ab3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.754650 Nov 22 10:37:17.806201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 209/421] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:17 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:17.811375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:17.826580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:17.842209 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.842651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.843497 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:17.843979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:17.943198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:37:17.945812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd5279d4-1219-4cf4-8f35-63e75557a9fa',volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:37:18.253219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fe2f0a0e-224f-4511-9dd2-a6d398e0b92d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.862601 Nov 22 10:37:18.253889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 213/422] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:37:15 2021] POST /compute/v2.1/servers => generated 405 bytes in 2864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:37:18.258620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:18.278222 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:18.289035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.289655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.290613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.291116 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.529804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:18.551238 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3af50d78-d4cf-4862-b318-8a97a563060c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.743569 Nov 22 10:37:18.553638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 210/423] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:17 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:18.564781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:18.569082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:18.580088 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.580623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.591202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.592285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.625041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:18.636059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c2eb6ea1-34c5-4d5a-8fce-1cdf38308bd0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.380767 Nov 22 10:37:18.637533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 214/424] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:18 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:18.642422 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-17c0ce5d-9dfe-4e62-9da3-e188b0060bea tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:18.643583 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-17c0ce5d-9dfe-4e62-9da3-e188b0060bea tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:18.797589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-17c0ce5d-9dfe-4e62-9da3-e188b0060bea tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:18.807238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-17c0ce5d-9dfe-4e62-9da3-e188b0060bea tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1088 microversion: 2.1 time: 0.168149 Nov 22 10:37:18.814211 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 215/425] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:18 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1088 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:18.823058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:18.829873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:18.837864 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.838468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.844453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:18.844917 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:18.995135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:19.012046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:19.014717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:19.015962 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3dc3276d-837f-49e8-b47b-65dce5adac76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.458979 Nov 22 10:37:19.016533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 211/426] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:18 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:19.396202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:19.408585 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-95e6b4d2-052a-4c65-9659-6deeda653d74 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.589815 Nov 22 10:37:19.411472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 216/427] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:18 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:19.570727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:19.571366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:19.583569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:19.584061 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:19.587164 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:19.588127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:19.654485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:19.655209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:19.667747 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:19.668234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:19.669170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:19.669596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:19.962332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:19.979559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-13282327-7526-425e-994a-0244bb04f64d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.412445 Nov 22 10:37:19.989210 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 212/428] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:19 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:19.992964 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:19.994600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:20.015812 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.016319 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.018582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.019986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.079018 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:20.089653 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a3ec9a1f-bbef-4978-8ed5-39f825ecb118 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.437786 Nov 22 10:37:20.099847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 217/429] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:19 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:20.111315 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:20.117261 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:20.146574 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.151570 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.157475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.157935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.319310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:20.332571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-39895396-8f3d-4276-bc76-032982fbb122 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1186 microversion: 2.1 time: 0.350091 Nov 22 10:37:20.334584 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 213/430] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:19 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1186 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:20.426919 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:20.427836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:20.435159 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.440412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.441650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:20.444774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:20.745314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:20.754968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:20.765357 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:20.767790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-07063240-c1f9-48d8-8527-a3e1764d242c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.671280 Nov 22 10:37:20.780032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 218/431] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:20 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:20.997043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:20.997640 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:21.011978 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.013303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:21.014360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.015382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.018445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.029464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b1e77827-5ec0-431f-819f-11c8425c4da2 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.602985 Nov 22 10:37:21.031613 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 214/432] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:20 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:21.111583 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:21.112692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:21.121966 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.124216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.125270 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.126729 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.580015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:21.591536 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:21.596494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1581f643-a043-48ba-a5ec-2ff7222284f6 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.602991 Nov 22 10:37:21.597129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 219/433] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:20 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:21.600583 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-64350865-3909-460a-baaa-c117d9848d60 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.494509 Nov 22 10:37:21.604339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:21.605695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 215/434] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:21 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:21.608692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:21.622885 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.623571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.627986 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.628652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.749792 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:21.759130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-227ce5f2-680d-47ac-90fb-b9fb3d07f104 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1192 microversion: 2.1 time: 0.160754 Nov 22 10:37:21.765280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 220/435] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:21 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1192 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:21.787614 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:21.788296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:21.800340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.803716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:21.804793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:21.805600 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:22.052045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:22.053248 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:22.072980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:22.073569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:22.082743 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:22.083445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:22.173907 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:22.191394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:22.194676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:22.197058 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bbe7063d-a433-40f1-843d-fa8d0fb2fd2e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.413248 Nov 22 10:37:22.199543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 216/436] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:21 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:22.625887 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:22.627004 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:22.644204 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:22.645051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:22.646095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:22.646755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:22.912586 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:22.964759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b09f5e6f-bc9a-48eb-a332-cc6b4e1f02e9 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.912106 Nov 22 10:37:22.984740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 221/437] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:22 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:23.020022 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:23.024558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:23.047961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.050103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.052203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.053216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.312590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:23.332546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6487fb1c-5200-4220-a39b-bbaefef390e8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1721 microversion: 2.1 time: 0.708276 Nov 22 10:37:23.336481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 217/438] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:22 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1721 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:23.347120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:23.348030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:23.368570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.373995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.375308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.376463 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.569156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:23.580108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0364b086-0cee-4773-b7f3-c170ed4c01ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.593372 Nov 22 10:37:23.595453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 222/439] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:22 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:23.600586 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:23.609387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:23.616723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.618312 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.620928 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:23.625451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:23.785123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:23.799834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fd03367b-95b0-4025-a821-5041f62593a0 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.457805 Nov 22 10:37:23.800797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 218/440] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:23 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:24.002975 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:24.006549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:24.034972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.035684 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.036659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.037310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.107133 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:24.120388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:24.121911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:24.123175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5cef09b1-8451-4367-87e6-6547d3ab4233 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.526606 Nov 22 10:37:24.146477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 223/441] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:23 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:24.351410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:24.352633 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:24.365499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.367300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.368714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.371524 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.372184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:24.384531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-92b8d4f9-d347-406a-803a-7bc51fbf35fc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.388659 Nov 22 10:37:24.388060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 219/442] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:23 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:24.602215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:24.604615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:24.619553 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.620299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.621313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.623404 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.881145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:24.893414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ec39d7b7-489a-4936-bcf6-4334b2627d08 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1698 microversion: 2.1 time: 0.546774 Nov 22 10:37:24.896690 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 224/443] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:24 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1698 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:24.907193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:24.912834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:24.921548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.923584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:24.926289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:24.932769 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.121763 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:25.146689 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-97052bf7-c76a-4b02-8f92-cd11dd6335db tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.546651 Nov 22 10:37:25.147461 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 220/444] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:24 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:25.176064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-b2dbbc9d-bff9-4d8b-b095-b1862b008122 req-51bb9ef2-a89c-4dcb-9383-260273db360e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:25.196565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:25.196565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:37:25.217953 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b2dbbc9d-bff9-4d8b-b095-b1862b008122 req-51bb9ef2-a89c-4dcb-9383-260273db360e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.218511 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b2dbbc9d-bff9-4d8b-b095-b1862b008122 req-51bb9ef2-a89c-4dcb-9383-260273db360e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.272544 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-b2dbbc9d-bff9-4d8b-b095-b1862b008122 req-51bb9ef2-a89c-4dcb-9383-260273db360e service nova] Creating event network-changed:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:37:25.288372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-b2dbbc9d-bff9-4d8b-b095-b1862b008122 req-51bb9ef2-a89c-4dcb-9383-260273db360e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116626 Nov 22 10:37:25.289875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 221/445] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:25.307683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7b0309d5-3af4-4eee-bee5-ab41572571bb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:25.311098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:25.321787 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-01b60841-0bae-419a-99a0-3f477224cb72 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.423623 Nov 22 10:37:25.325637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b0309d5-3af4-4eee-bee5-ab41572571bb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.326407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b0309d5-3af4-4eee-bee5-ab41572571bb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.336145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 225/446] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:24 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:25.357614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:25.360517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:25.392299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.392781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.394334 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.394812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.549355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7b0309d5-3af4-4eee-bee5-ab41572571bb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Going to try to start instance {{(pid=122857) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 10:37:25.664965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7b0309d5-3af4-4eee-bee5-ab41572571bb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 202 len: 0 microversion: 2.1 time: 0.373181 Nov 22 10:37:25.669637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 222/447] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:37:25 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:37:25.678233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:25.679247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:25.691316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.697331 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.699119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.702482 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.785375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:25.794856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:25.796404 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:25.797577 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8e070df7-2fd9-41e4-9464-0b6622b3477c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.460091 Nov 22 10:37:25.820128 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 226/448] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:25 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:25.825149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-4d789eb7-d615-4c1c-950c-aa2a6d8d2294 req-e8adfa53-b572-4845-8a0e-9769306d6e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef620a8a-291f-484a-aacb-17f63097f482", "name": "network-vif-plugged", "status": "completed", "tag": "8fcdd3ad-842b-4a16-9297-c14e81508bca"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:25.826763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:25.826763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:37:25.845983 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-4d789eb7-d615-4c1c-950c-aa2a6d8d2294 req-e8adfa53-b572-4845-8a0e-9769306d6e08 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.846428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-4d789eb7-d615-4c1c-950c-aa2a6d8d2294 req-e8adfa53-b572-4845-8a0e-9769306d6e08 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.871692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-4d789eb7-d615-4c1c-950c-aa2a6d8d2294 req-e8adfa53-b572-4845-8a0e-9769306d6e08 service nova] Creating event network-vif-plugged:8fcdd3ad-842b-4a16-9297-c14e81508bca for instance ef620a8a-291f-484a-aacb-17f63097f482 on hv-cinder-80403 Nov 22 10:37:25.885946 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-4d789eb7-d615-4c1c-950c-aa2a6d8d2294 req-e8adfa53-b572-4845-8a0e-9769306d6e08 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064272 Nov 22 10:37:25.886608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 227/449] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:25.891626 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:25.900178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:25.917245 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.918226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:25.919352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:25.920025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:26.246455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:26.256181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b8d39562-05ab-4fb1-ba4c-10d1e3901e58 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.583993 Nov 22 10:37:26.260671 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 223/450] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:25 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:26.272176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:26.272929 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:26.308777 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:26.309815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:26.310710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:26.311154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:26.978388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:26.991188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-80aed972-6177-43b1-9e18-65ae12bba662 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1707 microversion: 2.1 time: 1.103360 Nov 22 10:37:27.013549 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 228/451] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:25 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1707 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:27.035893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:27.038575 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:27.074413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.078224 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.088686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.089780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.350134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:27.368451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6cc85080-a415-4eec-9887-db49e2887f49 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 1.107200 Nov 22 10:37:27.369366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 224/452] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:26 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:27.373901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:27.374780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:27.390430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.391152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.392143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.392719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.622523 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:27.635066 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-087e5549-0846-49a5-a86e-a5491ce059cd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.614411 Nov 22 10:37:27.636107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 229/453] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:27 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:27.654303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:27.654941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:27.677234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.677868 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.678713 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:27.680272 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:27.873474 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:27.882487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:27.884290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:27.885552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0627fac0-a254-410f-96f7-50c75be757d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.515202 Nov 22 10:37:27.904078 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 225/454] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:27 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:28.030804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:28.031420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:28.041604 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.042054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.042865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.043295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.263869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:28.272608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-192c421a-49ac-4773-90ae-07befda1c538 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.635357 Nov 22 10:37:28.277126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 230/455] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:27 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:28.386692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:28.387482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:28.399174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.404178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.405348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.406385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.631456 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:28.644160 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b0306058-b3f8-4215-89fb-6a7b263eef4d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1707 microversion: 2.1 time: 0.613401 Nov 22 10:37:28.644831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 226/456] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:28 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1707 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:28.660426 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:28.661094 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:28.677649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.678113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.680245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.680691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.801268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:28.810318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9456d48d-8f40-409f-8b39-2220e13bcf00 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1317 microversion: 2.1 time: 0.427557 Nov 22 10:37:28.815650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 231/457] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:28 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:28.926675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:28.927678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:28.935394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.936196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:28.937227 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:28.937836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.057746 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.067394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-de4a2062-fff3-4a1c-b8d6-203d315b5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.412859 Nov 22 10:37:29.068886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 227/458] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:28 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:29.174170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.183002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.184548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.185820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1e2f6d4c-a190-45e0-aaf0-17a090ef446c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.268412 Nov 22 10:37:29.191067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 232/459] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:28 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:29.305875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:29.307341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:29.316657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.338207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.339360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.339974 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.636526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.645193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-43db9de6-35c1-4201-b1dd-e3c3c189652b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.354272 Nov 22 10:37:29.658409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 228/460] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:29 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:29.665020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:29.665777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:29.678841 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.679579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.681078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.681599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.834020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:29.834654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:29.850576 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.851630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.855864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:29.861033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:29.946058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:29.956084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9a554653-58db-4a91-9687-d86d617ef3c5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1711 microversion: 2.1 time: 0.295283 Nov 22 10:37:29.969089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 233/461] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:29 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1711 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:30.085889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:30.087805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:30.099695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.105967 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.106844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.107301 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.131107 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.145398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6229e14b-3303-4eb2-a746-d27d1df186c8 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1507 microversion: 2.1 time: 0.315977 Nov 22 10:37:30.152117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 229/462] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:29 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:30.206246 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:30.207202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:30.216778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.217636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.221804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.222459 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.363790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.374775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-43aa1005-8889-44ca-995f-533dfd728fc5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.292735 Nov 22 10:37:30.393450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 234/463] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:30 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:30.433788 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.445921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.447478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.448753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-efa3b153-6988-4735-ac68-7ef782992dfa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1737 microversion: 2.20 time: 0.247273 Nov 22 10:37:30.449764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 230/464] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:30 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:30.668899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:30.670272 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:30.683749 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.686105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.688318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:30.690617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:30.935978 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:30.948412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0db6e44b-6427-4bfc-bcd2-b1f14eafd755 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.286241 Nov 22 10:37:30.959821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 235/465] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:30 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:31.399931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:31.401387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:31.417092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:31.419363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:31.421134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:31.423592 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:31.468517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:31.469667 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:31.481226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:31.481661 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:31.482637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:31.485372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:32.157697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:32.175704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:32.177451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:32.178817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db06e8ea-40a0-42d6-9f41-cfb71dd79e19 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1719 microversion: 2.20 time: 0.714088 Nov 22 10:37:32.179429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 236/466] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:31 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1719 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:37:32.186330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:32.187811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:32.188789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:32.195620 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7f9a532b-7e58-4a70-979e-259bae625265 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.800272 Nov 22 10:37:32.196518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 231/467] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:31 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:32.197474 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:32.197994 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:32.198980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:32.199510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:32.202174 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:32.202965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:32.209479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:32.210214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:32.211223 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:32.211862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:32.382754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:32.390954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-71fa0c98-399e-4703-b76c-dcaab068596b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.192688 Nov 22 10:37:32.391542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 232/468] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:32 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:32.606201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d4a20cac-ba69-49f8-8bfe-5d5121c39583 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423376 Nov 22 10:37:32.607216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 237/469] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:37:32 2021] POST /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:33.198539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:33.199137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:33.211630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.212097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.212887 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.213316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.214587 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:33.215283 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:33.225036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.225806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.226903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.227354 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.556269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:33.570558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cec86382-71c6-4567-9f5f-2d1f2412f902 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.361202 Nov 22 10:37:33.571262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 238/470] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:33 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:33.575942 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:33.576760 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:33.584338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.585063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.586099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:33.586716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:33.634987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:33.668762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:33.678595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:33.680333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8867dbbc-a948-43c2-93ad-6448e773b8a8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1719 microversion: 2.20 time: 0.485794 Nov 22 10:37:33.683032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 233/471] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:33 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1719 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:33.916706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:33.932459 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-da8f3b44-71ca-441f-9de8-1b232736b75d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1568 microversion: 2.1 time: 0.359263 Nov 22 10:37:33.933996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 239/472] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:33 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1568 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:34.588325 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:34.589006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:34.603299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.603747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:34.604756 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.606989 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:34.698744 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:34.700362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:34.708077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.709262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:34.710365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.711081 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:34.927938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:34.944457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-797643d9-d2d7-4892-a4f8-5fe783f77bda tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.358625 Nov 22 10:37:34.946368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 234/473] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:34 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:34.960747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:34.961433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:34.976224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.976761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:34.978018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:34.978472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.021831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:35.034527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:35.036354 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:35.037603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-15d253f2-3581-46f2-968d-91a03af02003 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1722 microversion: 2.20 time: 0.343000 Nov 22 10:37:35.038207 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 240/474] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:34 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1722 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:35.063354 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "12495a69-ec0f-495e-8bd3-60fee25b8f82"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.066644 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:35.080531 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.081035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.081907 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.082343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.193959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:35.203453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-728f769b-9499-4532-93c7-9f20f58b52bc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1548 microversion: 2.1 time: 0.255478 Nov 22 10:37:35.216071 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 235/475] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:34 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1548 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:35.224549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'create', calling method: .version_select at 0x7f1a595ae3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-472014356"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.246795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for project 549a9a424a794c74836d8d862db06e25. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:35.251547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for user a31a4da645e9478f875389f7c70d27cc and project 549a9a424a794c74836d8d862db06e25. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:35.511183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e0192b64-2114-4ccc-a82b-afbaf1e76440 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.456934 Nov 22 10:37:35.514144 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 241/476] 10.222.0.46 () {62 vars in 1363 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments => generated 188 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:37:35.520187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:35.520947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:35.532238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.533408 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.535219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.535883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.546129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for project 549a9a424a794c74836d8d862db06e25. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:35.551378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for user a31a4da645e9478f875389f7c70d27cc and project 549a9a424a794c74836d8d862db06e25. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:35.572480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cc7ff7fa-4482-4223-9b8b-87f13059f407 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.354000 Nov 22 10:37:35.580690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 236/477] 10.222.0.46 () {60 vars in 1157 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:35.592849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-75dbb558-2724-49bf-8ccf-2e906cfb35ab req-8b7f8805-fdbf-45d5-9605-85fe6dda9413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "name": "network-vif-unplugged", "status": "completed", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.595867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:35.595867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:37:35.606719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-75dbb558-2724-49bf-8ccf-2e906cfb35ab req-8b7f8805-fdbf-45d5-9605-85fe6dda9413 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.607485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-75dbb558-2724-49bf-8ccf-2e906cfb35ab req-8b7f8805-fdbf-45d5-9605-85fe6dda9413 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.625649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.compute.server_external_events [req-75dbb558-2724-49bf-8ccf-2e906cfb35ab req-8b7f8805-fdbf-45d5-9605-85fe6dda9413 service nova] Unable to find a host for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3. Dropping event network-vif-unplugged {{(pid=122857) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 22 10:37:35.628835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-75dbb558-2724-49bf-8ccf-2e906cfb35ab req-8b7f8805-fdbf-45d5-9605-85fe6dda9413 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045241 Nov 22 10:37:35.630057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 237/478] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 22 10:37:35.700963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.701593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:35.710379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.710883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.715818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.716759 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.737973 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] HTTP exception thrown: Cannot 'detach_volume' instance 60ede0be-83f5-416b-8ba7-216691a79cbc while it is in vm_state rescued Nov 22 10:37:35.741041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Returning 409 to user: Cannot 'detach_volume' instance 60ede0be-83f5-416b-8ba7-216691a79cbc while it is in vm_state rescued {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:37:35.742667 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9dfc5bf9-0796-4ff8-8c2d-61ab783aaa37 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments/e251c61e-927a-46df-8dff-f9dc8c0df9c2" status: 409 len: 152 microversion: 2.1 time: 0.227271 Nov 22 10:37:35.745790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 242/479] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:37:35 2021] DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments/e251c61e-927a-46df-8dff-f9dc8c0df9c2 => generated 152 bytes in 231 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 22 10:37:35.754573 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.757885 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:35.768031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.768943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.772253 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.773985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.841551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c2ca03d4-eaa5-404a-9ac5-602021f22918 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action" status: 202 len: 0 microversion: 2.20 time: 0.144074 Nov 22 10:37:35.842803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 238/480] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 22 10:37:35.850683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1312471037", "imageRef": "d32ab27b-bd42-436d-9e53-6ee73c5f8b06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-472014356", "networks": [{"uuid": "a43393e9-8ccf-4b0e-a223-5dd0a65e3eb0"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:35.899233 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f8436e41-a97c-4793-9ff3-7609c5ea3bba tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action" status: 202 len: 0 microversion: 2.1 time: 0.149501 Nov 22 10:37:35.900180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 243/481] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:37:35.905069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:35.905777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:35.913002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.913659 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.914552 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:35.915025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:35.933832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] validate_networks() for [('a43393e9-8ccf-4b0e-a223-5dd0a65e3eb0', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:37:36.301383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:36.317356 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:36.320940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:36.324276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3a09a5eb-7782-43fb-8812-a4c430187ed9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1748 microversion: 2.20 time: 0.422882 Nov 22 10:37:36.327097 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 244/482] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:35 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1748 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:36.332607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:36.333297 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:36.340320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.340896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.341902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.342475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.768774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:36.781630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e35d4afd-c22f-4768-a981-fe748690c212 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.452740 Nov 22 10:37:36.783538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 245/483] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:36 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:36.789925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:36.790750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:36.797698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.798429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.799231 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.799929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.842135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:37:36.843156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:37:36.843828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:37:36.844421 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:37:36.844826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:37:36.855325 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.856380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.858274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:36.858707 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:36.882139 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for project 549a9a424a794c74836d8d862db06e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:36.887310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Getting quotas for user a31a4da645e9478f875389f7c70d27cc and project 549a9a424a794c74836d8d862db06e25. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:36.900974 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:37:36.903290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d32ab27b-bd42-436d-9e53-6ee73c5f8b06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:37:36.997273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ce20e66d-295c-4287-a38a-31f3fa6bd236 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152621 Nov 22 10:37:36.999791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 239/484] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:37:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:37:37.009603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-64f51cc6-3b92-41cd-b6b9-47a74f7b175c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:37.010632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-64f51cc6-3b92-41cd-b6b9-47a74f7b175c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:37.448634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-64f51cc6-3b92-41cd-b6b9-47a74f7b175c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.459202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-64f51cc6-3b92-41cd-b6b9-47a74f7b175c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1258 microversion: 2.1 time: 0.453809 Nov 22 10:37:37.462455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 240/485] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:37 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1258 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:37.479537 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:37.481599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:37.502567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:37.503386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:37.504562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:37.506735 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:37.520059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.532816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8008c7c6-9304-48c2-9d4f-0396b80adceb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.747268 Nov 22 10:37:37.533637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 246/486] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:36 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:37.717106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.728099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.730769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.732768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-22123a87-5b87-422a-9bec-ed8e8dd45798 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.266753 Nov 22 10:37:37.733695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 241/487] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:37 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:37.800170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:37.800766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:37.808914 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:37.809740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:37.810764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:37.811411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:37.962811 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:37.973336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-61a1ca3f-70bd-4b2c-bd63-75f20eb88bcc tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.176185 Nov 22 10:37:37.974244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 247/488] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:37 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:38.485025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:38.485578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:38.492008 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.492472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.493299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.493952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.550838 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:38.551807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:38.558683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.559303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.559963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.560456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.585097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:38.604567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a0652358-e67a-4d91-82ad-e301fb83a659 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1318 microversion: 2.1 time: 0.123359 Nov 22 10:37:38.605220 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 242/489] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:38 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:38.752960 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:38.753571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:38.760580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.761073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.761888 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:38.762307 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:38.797639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:38.806311 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6a101dbd-65e8-4b58-977b-eb74d780b4a6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.259573 Nov 22 10:37:38.806991 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 248/490] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:38 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:38.953874 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:38.962480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:38.963998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:38.965196 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-78dd2b76-5b11-462c-9049-e7206bed91ac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.216188 Nov 22 10:37:38.965802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 243/491] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:38 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:38.997388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:38.998199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:39.006516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.007039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.008006 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.008589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.042351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-301736423", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "8322e46a-3342-4b13-a227-93a753c68c4d"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:39.109378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] validate_networks() for [('8322e46a-3342-4b13-a227-93a753c68c4d', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:37:39.399372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:39.412898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-48d3cb66-f92f-4107-84c6-06345b25945f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.419800 Nov 22 10:37:39.415803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 249/492] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:38 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:39.575447 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-b7158a80-d7cf-43e0-808c-fddbd2413986 req-60769e0c-35c4-4d8f-9024-d4ec4b3a2631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "name": "network-vif-plugged", "status": "completed", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:39.577150 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:39.577150 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:37:39.597165 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b7158a80-d7cf-43e0-808c-fddbd2413986 req-60769e0c-35c4-4d8f-9024-d4ec4b3a2631 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.597612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b7158a80-d7cf-43e0-808c-fddbd2413986 req-60769e0c-35c4-4d8f-9024-d4ec4b3a2631 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.612365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-b7158a80-d7cf-43e0-808c-fddbd2413986 req-60769e0c-35c4-4d8f-9024-d4ec4b3a2631 service nova] Creating event network-vif-plugged:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:37:39.629556 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-b7158a80-d7cf-43e0-808c-fddbd2413986 req-60769e0c-35c4-4d8f-9024-d4ec4b3a2631 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057621 Nov 22 10:37:39.630256 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 250/493] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:37:39.646979 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:39.647680 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:39.663724 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.664307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.665116 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.665547 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.945762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:37:39.946428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:37:39.946742 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:37:39.947325 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:37:39.947939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:37:39.965649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.966148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:39.967043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:39.967479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.007186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Getting quotas for project 93b9423a62144c8a975aacb49a424865. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:40.012855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Getting quotas for user 2613f7c84b1540829f4cdeb9c28b8f5b and project 93b9423a62144c8a975aacb49a424865. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:40.037483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:37:40.039804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:37:40.042785 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.051643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-92ebbf23-4402-45c4-86e5-8ffc43e323b4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.420251 Nov 22 10:37:40.052409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 251/494] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:39 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:40.062112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:40.062732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:40.081465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.081958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.082808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.083243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.123588 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7706dae3-ee22-4829-a00f-29c2e777db2e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.085585 Nov 22 10:37:40.124381 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 244/495] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:37:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:37:40.137316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:40.138274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:40.162179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.162977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.164481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.165468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.332300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.342899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d31d24f8-60ab-4078-a0b5-d25b9fce690b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.289480 Nov 22 10:37:40.343947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 252/496] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:40 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:40.352990 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9de83b66-c296-4023-88d1-2fd4a5543a08 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:40.353624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9de83b66-c296-4023-88d1-2fd4a5543a08 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:40.425295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9de83b66-c296-4023-88d1-2fd4a5543a08 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.443242 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9de83b66-c296-4023-88d1-2fd4a5543a08 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1218 microversion: 2.1 time: 0.095251 Nov 22 10:37:40.444897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 253/497] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:40 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:40.449738 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:40.450592 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:40.460118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.460611 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.461766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:40.467007 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:40.468521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.485121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.487086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.489268 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f081857c-b761-420b-9ab5-f86ec44b03b0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.355902 Nov 22 10:37:40.492277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 245/498] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:40 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:40.656784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:40.671125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7d4bcd31-bf11-41f7-9096-3c59fbfbdc21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.224354 Nov 22 10:37:40.672190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 254/499] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:40 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:41.069517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:41.070139 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:41.076818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.077264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.078059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.078492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.225526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.234374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f8a87531-6b34-4b52-8996-b3fd2000f68d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.168624 Nov 22 10:37:41.235240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 246/500] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:41 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:41.362129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:41.362857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:41.369965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.370412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.371206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.371640 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.464184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:41.464184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:41.470808 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.471523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.472748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.473276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.559100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.564517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.568112 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-83a7a648-93c9-49c9-84f1-8bb4bec6407d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.110000 Nov 22 10:37:41.569076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 247/501] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:41 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:41.572520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b2eb3d37-f1eb-4e63-8615-bd16d9d9227f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.214771 Nov 22 10:37:41.573764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:41.574366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:41.581335 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.581855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.582274 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 255/502] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:41 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:41.582768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.583257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.689475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:41.690090 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:41.696624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.697076 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.697868 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:41.698296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:41.727485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.736481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.737965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.739129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-142e7ec4-29c2-4c5e-89c0-57361c1bfafe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.169117 Nov 22 10:37:41.739899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 248/503] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:41 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:41.844746 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:41.853629 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-feed2620-affa-4a0d-9283-ba9d2824b1c0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.168090 Nov 22 10:37:41.854198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 256/504] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:41 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:42.252275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:42.253049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:42.260263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.260801 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.261675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.262098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.405428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.413031 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cac008cc-fa29-4c51-98f8-2d8c71be58cf tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.164518 Nov 22 10:37:42.413674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 249/505] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:42 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:42.585982 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:42.586687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:42.590026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:42.590643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:42.593777 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.594320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.595197 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.595716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.597478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.597957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.598733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.599776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.688973 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.696685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1a5d4f7e-c42b-42ed-b67e-4cbb8730c558 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.114858 Nov 22 10:37:42.697392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 257/506] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:42 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:42.758271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:42.759064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:42.765982 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.766578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.767498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.768372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.780074 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.788992 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fb270cd8-f12d-4706-a63b-6174903e40e8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.203000 Nov 22 10:37:42.790790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 250/507] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:42 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:42.870457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:42.871359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:42.878961 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.892943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.894690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:42.895761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:42.933924 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.943455 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.947322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:42.947322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f3360aa5-1ca3-435a-99ed-a961b1735f17 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.192260 Nov 22 10:37:42.953703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 258/508] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:42 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:37:43.052263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:43.061799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-60bbec1b-eaac-4651-83f1-abdad3de5a08 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.194972 Nov 22 10:37:43.062566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 251/509] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:42 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:43.430353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:43.431381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:43.438822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.439147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.439986 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.440435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.589920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:43.600952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-38a3cf86-52f3-4524-bd3d-b8a9b2643040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.174609 Nov 22 10:37:43.601718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 259/510] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:43 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:43.714738 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:43.715541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:43.723403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.724199 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.724991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.725396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.789769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:43.797764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-99cb1c40-9815-4830-81e5-531334df72fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.087541 Nov 22 10:37:43.798423 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 252/511] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:43 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:43.806539 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:43.807165 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:43.813575 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.814043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.816731 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.817248 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.966573 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:43.967186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:43.973340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.974096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.974885 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:43.975314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:43.977757 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:43.986115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fc279de7-9337-46af-abfd-9605a65dfdcb tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.183307 Nov 22 10:37:43.987080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 260/512] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:43 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:44.079795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:44.081197 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:44.088064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.088595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.089650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.090139 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.174077 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.183821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.185427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.186716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4ed9aaa7-637f-4039-b541-7cbf08686e78 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.224165 Nov 22 10:37:44.187839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 253/513] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:43 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:44.258840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.268053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a33cf5a4-2d14-44a2-84a6-2acb53965d8f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.191933 Nov 22 10:37:44.268661 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 261/514] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:44 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:44.618758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:44.619350 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:44.626656 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.626656 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.627194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.627622 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.772149 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.780353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3986ef15-0630-46dd-97f4-0b23fa8ebc23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.165432 Nov 22 10:37:44.780978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 254/515] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:44 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:44.814380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:44.815039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:44.821992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.822443 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.823243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:44.823702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:44.887646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:44.895572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9a7ed219-6ccf-49cc-a0fe-38bb68b1b37c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.084900 Nov 22 10:37:44.896195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 262/516] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:44 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:45.003726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:45.004249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:45.011391 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.011893 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.012717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.013142 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.158870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.166570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-51f4415a-682c-4411-aa5d-7b1b5a1d5c6e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.166767 Nov 22 10:37:45.167169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 255/517] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:44 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:45.206401 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:45.207010 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:45.214206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.214660 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.215451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.215941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.285989 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:45.289571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:45.312393 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.312845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.313636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.314069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.373664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.383461 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.385173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.387125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-32ac05b9-5bd5-45e4-aa53-04425c649ddb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.183955 Nov 22 10:37:45.387125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 263/518] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:45 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:45.467013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.479816 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f617536b-cba9-44e4-8adb-e4f391dcf044 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.193682 Nov 22 10:37:45.480624 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 256/519] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:45 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:45.798162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:45.798800 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:45.805562 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.806013 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.806794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.807220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.912346 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:45.913032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:45.919780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.920273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.921041 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:45.921477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:45.949086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.957327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-192f81cc-6212-4735-a20c-d6daca638677 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.162885 Nov 22 10:37:45.958183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 264/520] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:45 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:45.988839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:45.997148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-eabfd60f-9ee4-4dda-85e8-228b6a4483f6 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.088774 Nov 22 10:37:45.997696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 257/521] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:45 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:46.184622 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:46.185304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:46.192425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.192892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.193704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.194143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.336775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:46.344447 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-456e588c-f8f0-4039-bcd8-e069fc53b8af tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.164037 Nov 22 10:37:46.345025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 265/522] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:46 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:46.405233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:46.405911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:46.412471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.412923 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.413872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.414585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.497782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:46.498266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:46.504866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.505631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.506480 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.506978 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.568021 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:46.578992 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:46.580546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:46.581757 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-72169e06-4c47-4818-a5d4-e6d5474a8d03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.180579 Nov 22 10:37:46.582465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 258/523] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:46 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:46.667700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:46.676679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e858071d-b590-49d1-96f0-07c25299d9c3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.182709 Nov 22 10:37:46.677540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 266/524] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:46 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:46.978526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:46.979585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:46.987491 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.988049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:46.988880 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:46.989341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.014123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:47.015091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:47.021874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.022300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.023130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.023625 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.101926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.110750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f6f0a902-c44b-44f6-b6b8-6099b8f9fe7f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.100318 Nov 22 10:37:47.111721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 267/525] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:47 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:47.173957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.182561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8d043d5a-44d6-43a8-9551-0a47a138edde tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.210333 Nov 22 10:37:47.183275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 259/526] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:46 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:47.361219 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:47.361871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:47.368894 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.369372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.370156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.370602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.546050 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.554825 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e9c7820e-ced5-4df6-8ad7-e4c05d714054 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.197149 Nov 22 10:37:47.555806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 268/527] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:47 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:47.601442 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:47.602318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:47.608998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.609533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.610397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.610898 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.694540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:47.695474 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:47.702477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.711287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.712617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:47.713079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:47.767514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.781332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.783578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.785772 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c493c8bb-e657-40b1-9c0f-5026f2a56ba7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.188624 Nov 22 10:37:47.786318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 260/528] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:47 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:47.894619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:47.904386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5addcdb3-bcd7-4353-9842-8cb5ef69201a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.213719 Nov 22 10:37:47.905161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 269/529] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:47 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:48.133651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:48.134281 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:48.141580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.141939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.142768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.143165 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.203548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:48.204617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:48.215169 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.215169 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.216369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.216534 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.216952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.228096 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-34b60e8e-5a31-4a0a-b0a0-1de0a472351b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.098540 Nov 22 10:37:48.229133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 261/530] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:48 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:48.367185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.375905 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3de61a9e-6427-4cc5-a6ab-ea424baa8119 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.178105 Nov 22 10:37:48.377966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 270/531] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:48 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:48.572236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:48.572837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:48.579305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.579806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.580638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.581085 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.765907 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.775695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-eb5482f1-4339-4d37-83ca-3eb5022af9c6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.207632 Nov 22 10:37:48.776313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 262/532] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:48 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:48.810025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:48.810630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:48.817022 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.817449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.818226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.818654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.938020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:48.938771 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:48.946702 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.947885 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.948767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:48.949205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:48.966822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.989055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.990880 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:48.992774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9705e053-81eb-483f-938f-baac35ed5b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.186390 Nov 22 10:37:49.003961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 271/533] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:48 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:49.153110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:49.163273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-49ae1ffb-0afb-499e-b169-36d89bdfd3d3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.232380 Nov 22 10:37:49.164082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 263/534] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:48 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:49.246011 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:49.246591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:49.253973 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.254652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.255626 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.256063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.324783 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:49.332618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fff740bd-390a-47cd-8471-af3b041d8b62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.090750 Nov 22 10:37:49.333199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 272/535] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:49 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:49.395942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:49.396549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:49.402932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.403371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.404191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.404618 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.560124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:49.568351 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a48c262b-1a06-4152-9236-07c6777bbbf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.176556 Nov 22 10:37:49.569565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 264/536] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:49 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:49.794322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:49.795175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:49.803433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.804086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.805043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:49.805561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:49.971168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:49.980684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-62922089-180d-40eb-b0ee-dde5f6f28466 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.190902 Nov 22 10:37:49.981501 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 273/537] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:49 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:50.014428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:50.014910 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:50.021338 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.021783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.022635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.023062 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.173667 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.182928 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:50.183185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.183723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:50.184536 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.185730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0a0e1230-252c-429f-898c-2d12c02030f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.175133 Nov 22 10:37:50.186547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 265/538] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:50 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:50.194093 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.194684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.196137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.196581 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.347185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.353776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:50.354650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:50.357214 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fcce7fc5-fdde-4cc9-a493-545ed319bf6b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.179720 Nov 22 10:37:50.368661 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.368932 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 274/539] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:50 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:50.369124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.369931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.370355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.441897 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.450296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d369bc15-cb6f-4d60-9de7-c3bcce4e31f9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.101541 Nov 22 10:37:50.450884 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 266/540] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:50 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:50.586688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:50.587328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:50.594192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.594822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.595681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:50.596218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:50.737174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:50.745290 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8ee33e10-4297-4682-92e5-59ccc2a614be tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.162666 Nov 22 10:37:50.746092 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 275/541] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:50 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:50.997689 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:50.998424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.005353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.005801 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.006585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.006999 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.146373 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.154510 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3bc5c8fe-44c4-4854-b8c8-d74c6fd514f3 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.160526 Nov 22 10:37:51.155099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 267/542] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:50 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:51.204774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:51.205413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.211858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.212303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.213069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.213493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.351464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.360122 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.361629 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.363225 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-08231428-d311-47d5-b5d1-fdc36bfd5b47 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.161807 Nov 22 10:37:51.363834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 276/543] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:51 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:51.375983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:51.376589 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.383306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.383826 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.384565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.384988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.469198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:51.470853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.489664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.490410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.491321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.491978 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.612569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.618009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:51.622049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bf1429a6-ed72-4ff1-b692-635936ea0d21 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1556 microversion: 2.1 time: 0.249805 Nov 22 10:37:51.632703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cfa5285f-5a7c-4c50-b35b-5dcb6f52be4d tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1222 microversion: 2.1 time: 0.161851 Nov 22 10:37:51.632703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 277/544] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:51 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:51.633376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 268/545] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:51 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:51.763067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:51.763912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.777055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.777658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.778688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.779297 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.973416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:51.975369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:51.982837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.983206 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:51.984242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:51.984500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.084910 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Invalid volume: volume f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8 is already attached to instances: ef620a8a-291f-484a-aacb-17f63097f482 Nov 22 10:37:52.085899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 400 to user: Invalid volume: volume f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8 is already attached to instances: ef620a8a-291f-484a-aacb-17f63097f482 {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:37:52.086798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9959ed3a-4bd6-4770-ad9c-975335219d33 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.118504 Nov 22 10:37:52.087563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 269/546] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:37:51 2021] POST /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:37:52.153662 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:52.154242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:52.160938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.161384 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.162179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.162607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.289651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'services' on Instance uuid ef620a8a-291f-484a-aacb-17f63097f482 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:37:52.377875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-778ef977-e7e3-4107-8e73-4e2d38afe5b6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments/f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8" status: 202 len: 0 microversion: 2.1 time: 0.228677 Nov 22 10:37:52.378658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 270/547] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:37:52 2021] DELETE /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments/f79170f5-4eb4-4c7d-ba9f-9bc47cb406f8 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:37:52.384762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:52.385507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:52.391986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.392436 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.393234 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.393675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.407136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:52.419252 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-023f0fd0-33ce-413e-aca4-dd21a7f1435b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.659470 Nov 22 10:37:52.423036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 278/548] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:51 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:52.430578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:52.434484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:52.441850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.442216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.443700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.444201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.897272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:52.911472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9872354c-b636-461e-a5f4-1b1ba5ceef7f tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1259 microversion: 2.1 time: 0.531465 Nov 22 10:37:52.912972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 271/549] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:52 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1259 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:52.918970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:52.920357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:52.924740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:52.935362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:52.937268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:52.938698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b41d59a7-a536-411d-a68c-2c11212a32b6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1750 microversion: 2.20 time: 0.513897 Nov 22 10:37:52.940216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 279/550] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:52 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1750 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:52.950441 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:52.952428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.953106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.954136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.954719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.955278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:52.966068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.966533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:52.968761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:52.969448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.021053 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9f27ef4a-772f-45da-96f8-3c4ebdf13ff7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106592 Nov 22 10:37:53.022042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 272/551] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:52 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:53.027272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:53.028059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:53.034828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.035555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.036564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.037148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.160069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:53.169469 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5eccde89-dc47-4c70-a3ea-5c15e1247c24 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1278 microversion: 2.1 time: 0.145923 Nov 22 10:37:53.170396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 273/552] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:53 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:53.438676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:53.439548 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:53.447468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.448133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.449093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.449517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.476658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:53.487572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ff0cccf7-9c9b-4d40-8e87-44e8c1146372 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1562 microversion: 2.1 time: 0.546110 Nov 22 10:37:53.488203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 280/553] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:52 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1562 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:53.589412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:53.590329 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:53.600857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.602016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.603903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.604562 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.717661 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lazy-loading 'services' on Instance uuid 60ede0be-83f5-416b-8ba7-216691a79cbc {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:37:53.886218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-79c7ddec-5212-4e47-b1fd-5aca1ff8cde1 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments/e251c61e-927a-46df-8dff-f9dc8c0df9c2" status: 202 len: 0 microversion: 2.1 time: 0.301387 Nov 22 10:37:53.887365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 281/554] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:37:53 2021] DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments/e251c61e-927a-46df-8dff-f9dc8c0df9c2 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:37:53.895911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-19517d27-9c9a-434f-ae63-75ddbf89797b req-f0396bfe-f7e8-4d8a-a789-7b0c3e49bb1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:53.898509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:53.898509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:37:53.907005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-19517d27-9c9a-434f-ae63-75ddbf89797b req-f0396bfe-f7e8-4d8a-a789-7b0c3e49bb1a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.907911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-19517d27-9c9a-434f-ae63-75ddbf89797b req-f0396bfe-f7e8-4d8a-a789-7b0c3e49bb1a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.934294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-19517d27-9c9a-434f-ae63-75ddbf89797b req-f0396bfe-f7e8-4d8a-a789-7b0c3e49bb1a service nova] Creating event network-changed:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:37:53.949673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-19517d27-9c9a-434f-ae63-75ddbf89797b req-f0396bfe-f7e8-4d8a-a789-7b0c3e49bb1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060570 Nov 22 10:37:53.950330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 282/555] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:53.959971 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:53.961285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:53.968456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.968993 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:53.969957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:53.970471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.039472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bb1fe027-b041-44bd-a9d8-84daf2f88522 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085508 Nov 22 10:37:54.040853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 283/556] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:53 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:54.048118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:54.048858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:54.058669 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.059442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.060500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.061105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.071478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:54.087857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-49573ba3-8002-4af9-aadb-0cf5d8fdd792 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.649090 Nov 22 10:37:54.089643 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 274/557] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:53 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:54.098883 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:54.102286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:54.114073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.114988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.117940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.118928 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.586210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:54.596734 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c2e9ec36-5c44-48ce-a05b-4acb9773f0fd tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1443 microversion: 2.1 time: 0.554713 Nov 22 10:37:54.598129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 284/558] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:54 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1443 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:54.604794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:54.606338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:54.614046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.614834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.617100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.618005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.621911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:54.633867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:54.635985 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:54.638291 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1aae4508-0ae2-439d-8dc5-ecd051af2986 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.545566 Nov 22 10:37:54.639361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 275/559] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:54 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:54.656658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:54.657604 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:54.664998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.666093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.667098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.668110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.694651 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fe4d5b1e-0ebe-4b6c-a7e8-d109c7924613 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094589 Nov 22 10:37:54.700414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 285/560] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:54 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:37:54.709709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:54.711304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:54.721687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.722756 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:54.724277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:54.724889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:55.536957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:55.540069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:55.548286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f183c5fa-2866-425e-a382-509051bf6ef5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.897119 Nov 22 10:37:55.560136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 276/561] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:54 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:55.560382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fd48be17-4d9b-42fe-8d34-d104fcdfc111 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1443 microversion: 2.1 time: 0.847699 Nov 22 10:37:55.560382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 286/562] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:54 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1443 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:55.560382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:55.560382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:55.566974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:55.567482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:55.569415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:55.569794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:55.573382 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1734073711", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "1739dec4-235e-4240-8471-290e5b4cd168"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:55.614971 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b7dc09cb-10bf-4da8-b194-258bab293094 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063681 Nov 22 10:37:55.615578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 287/563] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:37:55 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:37:55.632397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] validate_networks() for [('1739dec4-235e-4240-8471-290e5b4cd168', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:37:55.636723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:55.637831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:55.654393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:55.654863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:55.655736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:55.656313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.048657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.059382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-540d8bc5-f3d5-4476-ba26-5eb30ddae75b tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.442715 Nov 22 10:37:56.059999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 288/564] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:55 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:56.064923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:56.065718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:56.073472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.074189 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.075552 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.076020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.443699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.453202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.454922 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.456264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-52fe3def-5714-4def-9b33-678369f94c06 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.395027 Nov 22 10:37:56.456934 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 289/565] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:56 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:56.495978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:37:56.496677 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:37:56.497153 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:37:56.497574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:37:56.498080 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:37:56.509586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.510357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.511382 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.512023 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.532791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:37:56.537457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Getting quotas for user d68748d566954625ac4a353c2a08b253 and project a3d11e30d2104dbf9ece93bc38472a72. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:37:56.549028 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:37:56.551563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:37:56.567537 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:56.568931 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:56.576897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.577347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.578189 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:56.578624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:56.604944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ce168ec1-d8e2-41f9-b606-4bad13752e6c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.054614 Nov 22 10:37:56.606121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 277/566] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:37:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:37:56.615963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f74a1705-df6a-4725-b442-51ee8c472aa5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:56.617205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f74a1705-df6a-4725-b442-51ee8c472aa5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:56.739059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f74a1705-df6a-4725-b442-51ee8c472aa5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.751539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f74a1705-df6a-4725-b442-51ee8c472aa5 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1218 microversion: 2.1 time: 0.139560 Nov 22 10:37:56.755903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 278/567] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:56 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:56.913849 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:56.944221 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ad0d6c7e-1866-44e3-990c-163a691dba0b tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.381328 Nov 22 10:37:56.948647 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 290/568] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:56 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:57.078019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:57.078968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:57.087290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.088125 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.089314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.090221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.368162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:57.375503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7fc123d1-5bca-47de-8ce9-f7a226a33c48 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.302680 Nov 22 10:37:57.376127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 279/569] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:57 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:57.477129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:57.477821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:57.484976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.485431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.486236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.486682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.766318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:57.773998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:57.775345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:57.779997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:57.782027 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:57.783636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ee2bb262-d28a-41c7-ad42-022d7d2251fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.311187 Nov 22 10:37:57.784996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 291/570] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:57 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:37:57.796295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.796785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.797695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.798152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.883906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:57.896595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7d60ce6b-2476-47b2-bf28-88712103f09a tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.126516 Nov 22 10:37:57.898232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 280/571] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:57 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:57.964084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:57.964602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:57.971646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.972125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:57.972918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:57.974324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.159325 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:58.160334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:58.173024 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.173507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.174285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.174723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.201608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:37:58.277884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:58.288710 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-91cc2675-b20b-4f54-af81-ef45eec7483f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.328035 Nov 22 10:37:58.290399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-81f3038b-6c4f-4245-a68c-85ea2725c369 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 204 len: 0 microversion: 2.1 time: 0.134300 Nov 22 10:37:58.295169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 281/572] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:37:58 2021] DELETE /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:37:58.296859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 292/573] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:57 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:58.304375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:58.305414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:58.312128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.312529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.313346 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.313780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.392328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:58.393276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:58.400518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.400963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.401779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.402209 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.887233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:58.895535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:58.898438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5d8972c0-507d-4e9e-a93c-6d450e527472 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.600981 Nov 22 10:37:58.903295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 282/574] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:58 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:58.906034 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4c1fbd3a-ca5a-46e6-9071-059a40e58d16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.517487 Nov 22 10:37:58.910604 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 293/575] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:58 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:37:58.914559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:58.915952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:58.922522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:58.923509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:58.925969 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.926446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.928051 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.928495 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.931498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.932268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:58.933291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:58.933951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.048690 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:59.062945 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-501807b2-3c30-4590-a14f-56fcd26ea290 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.144054 Nov 22 10:37:59.066985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 294/576] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:58 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:59.160044 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-2f0ea882-394b-4abb-88c0-0be7955c0fed req-3b06bce5-c31a-4bb7-9998-8ed56d2c7d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:37:59.161791 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:37:59.161791 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:37:59.179557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-2f0ea882-394b-4abb-88c0-0be7955c0fed req-3b06bce5-c31a-4bb7-9998-8ed56d2c7d42 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.180032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-2f0ea882-394b-4abb-88c0-0be7955c0fed req-3b06bce5-c31a-4bb7-9998-8ed56d2c7d42 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.195826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-2f0ea882-394b-4abb-88c0-0be7955c0fed req-3b06bce5-c31a-4bb7-9998-8ed56d2c7d42 service nova] Creating event network-changed:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:37:59.202040 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-2f0ea882-394b-4abb-88c0-0be7955c0fed req-3b06bce5-c31a-4bb7-9998-8ed56d2c7d42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046845 Nov 22 10:37:59.202811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:59.203478 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 295/577] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:37:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:37:59.212836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:59.214356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:59.215555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8cec562e-5015-4426-be49-212142e5f0e0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.311112 Nov 22 10:37:59.216177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 283/578] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:37:58 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:37:59.314428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:59.315385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:59.322082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.322845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.323645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.324118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.498892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:37:59.509304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-868761c0-f51b-4c73-82a6-f434f90f06fe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.198883 Nov 22 10:37:59.518428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 296/579] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:59 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:37:59.915956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:59.917197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:59.924648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:37:59.925507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:37:59.934766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.935268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.936036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.937102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.940505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.940958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:37:59.941941 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:37:59.942385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.168990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.180942 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.181572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5e3fa75f-d161-45ae-a1c6-01448af0e991 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.269004 Nov 22 10:38:00.181572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 284/580] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:59 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:00.190155 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fc6bcad9-006d-4ce0-9f3c-dcbec25606c6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.269095 Nov 22 10:38:00.190839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 297/581] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:37:59 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:00.195151 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:00.195915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:00.203635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.204194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.205054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.205554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.234430 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:00.235076 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:00.267894 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.268342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.269160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.269590 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.295182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.306331 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2d0a3df4-c13a-41c6-9924-367999f9d25e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.123681 Nov 22 10:38:00.307333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 285/582] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:00 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:00.437399 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.455606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.478530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.482767 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c3485371-2b40-49a3-a90a-610e0d0d29aa tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.251349 Nov 22 10:38:00.500708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 298/583] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:00 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:38:00.526696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:00.527327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:00.534024 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.534463 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.535291 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:00.535900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:00.684046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:00.692629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-273f458a-6d1c-4131-94aa-b8039967d0dc tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.169631 Nov 22 10:38:00.693239 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 286/584] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:00 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:01.198892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:01.200436 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:01.207718 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:01.208997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:01.215828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.216160 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.216292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.216612 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.217064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.217388 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.217519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.217818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.438681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.443118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.451653 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-688ee0f0-e72e-4bb8-812e-f568b838c35e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.256733 Nov 22 10:38:01.452527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 299/585] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:01 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:01.454773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-07d88a35-7822-47b3-982e-61854b23f8f4 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.250558 Nov 22 10:38:01.457728 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:01.458505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:01.466115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 287/586] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:01 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:01.470786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.471272 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.472106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.472550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.502429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:01.503073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:01.509299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.509744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.510521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.510956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.539286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.551002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-230009d7-9c15-43ed-b45b-47d40b5b4a57 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.097040 Nov 22 10:38:01.551907 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 300/587] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:01 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:01.674530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.684273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.685761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.686947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8da8f5e6-1698-4dc5-97a7-a17f59e43b10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.188274 Nov 22 10:38:01.687525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 288/588] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:01 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:38:01.710572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:01.711285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:01.718348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.718997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.719835 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:01.720269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:01.867936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:01.875705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a7c13028-5bcf-44d2-a112-73e240cb2f29 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.169422 Nov 22 10:38:01.876319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 301/589] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:01 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:02.469866 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:02.470327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:02.473555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:02.474201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:02.477647 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.478111 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.478933 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.479373 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.481970 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.482420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.483323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.483890 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.697739 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.701601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.706248 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a2d032ea-4f2b-4ada-aa2c-c9cc769c279f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.240586 Nov 22 10:38:02.709569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5e14f435-0f3a-4dc4-b130-e91a8661a362 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.240035 Nov 22 10:38:02.717232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 289/590] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:02 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:02.719710 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 302/591] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:02 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:02.722525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:02.723524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:02.724652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:02.725497 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:02.730221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.730748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.731453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.731630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.731938 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.732238 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.732731 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.733460 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.821635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.829061 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-264fd651-e17a-4c93-8f07-7cfcf59e79bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.110517 Nov 22 10:38:02.829638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 290/592] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:02 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:02.896296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:02.896832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:02.903153 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.903607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.904441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:02.905035 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:02.907609 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.916693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.918178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:02.919346 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-494b171e-7764-4d6d-9276-26912c129da2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.198614 Nov 22 10:38:02.919944 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 303/593] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:02 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:03.044433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:03.052637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5bd6d916-4db7-484f-b31e-36c6e857b7e0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.160592 Nov 22 10:38:03.054245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 291/594] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:02 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:03.726039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:03.726655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:03.726748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:03.727398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:03.733488 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.734664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.735091 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.735552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.736220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.736410 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.736836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.737281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.953857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:03.957448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:03.968307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6711002e-7ee8-4dd4-9085-62695f83666e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.246971 Nov 22 10:38:03.968554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-01b7e384-f176-4743-b635-6d5279221165 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.245942 Nov 22 10:38:03.968996 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 292/595] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:03 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:03.978450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 304/596] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:03 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:03.978639 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:03.978734 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:03.978819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:03.978910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:03.981336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.981561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.981786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.982014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.982568 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.982798 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:03.982996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:03.983261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.070682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:04.079903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-119e36b6-d00b-4c78-9bea-dc769f5ec152 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.109764 Nov 22 10:38:04.080829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 293/597] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:03 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:04.085687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:04.086293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:04.092252 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.092856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.093491 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.093920 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.186617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:04.196406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:04.207238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:04.209203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f564ee9e-3d59-44e0-b3c2-e82f244cf490 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.238365 Nov 22 10:38:04.221215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 305/598] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:03 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:04.267256 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:04.275727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-20d7c130-c21c-42ee-a605-f0e7d3e548ef tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.193638 Nov 22 10:38:04.276347 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 294/599] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:04 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:04.986353 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:04.987042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:04.987439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:04.987562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:04.993761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.994015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.994270 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.994392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.995016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.995142 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:04.995458 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:04.995584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.206521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.214861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b01beb14-c126-4312-921f-6455a17ca0da tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.232273 Nov 22 10:38:05.221014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.224915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 306/600] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:04 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:05.229609 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2b2aa71d-2933-4582-bf11-6b9536dd0c23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.246951 Nov 22 10:38:05.230524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 295/601] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:04 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:05.235027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:05.235786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:05.241782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:05.242489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:05.245378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.245926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.246855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.247369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.249974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.250460 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.251268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.251701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.336957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.347014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-41849880-ec8d-4c67-aa7b-a7e375fe59bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.119492 Nov 22 10:38:05.348630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 307/602] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:05 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:05.354269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:05.355189 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:05.362506 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.362953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.363770 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:05.364202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:05.422703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.431591 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.433392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.434648 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-77966c10-2118-44d2-a171-5bea5c91f666 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.203294 Nov 22 10:38:05.435214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 296/603] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:05 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:05.515722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:05.527619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4822d7a2-0986-4531-b6b1-edf80d4d7a91 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.177474 Nov 22 10:38:05.528690 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 308/604] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:05 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:06.232854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:06.233592 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:06.240730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.241289 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.242549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.242758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.250230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:06.250230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:06.257112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.257664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.258484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.258937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.467472 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.475621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.476575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-85246ff1-ed6c-40ab-bbd0-2e848730f15b tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.247424 Nov 22 10:38:06.486180 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 297/605] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:06 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:06.486180 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:06.486180 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:06.486563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c4dce301-2b1a-4e1f-a196-73eb559fb8b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.239517 Nov 22 10:38:06.486563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 309/606] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:06 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:06.488829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.489277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.490065 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.490170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:06.490490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.490744 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:06.497654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.498250 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.499065 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.499505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.563153 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.571163 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6a4f5a24-f521-4add-902e-41f20b2ec41d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1222 microversion: 2.1 time: 0.092744 Nov 22 10:38:06.571769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 298/607] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:06 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:06.576208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:06.576819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:06.583243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.583786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.584599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:06.585031 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:06.699705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.709201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.710829 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.712185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d0a54824-e9bf-4753-ac93-02f010ed47f6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.225661 Nov 22 10:38:06.713092 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 310/608] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:06 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:06.765494 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:06.773571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-21564ac6-5d10-4c9d-87a4-b1cada481ad5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.200769 Nov 22 10:38:06.774153 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 299/609] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:06 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:07.496603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:07.496603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:07.503784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.504442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.504687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:07.505686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.506730 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.507139 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:07.515037 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.515572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.516676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.517181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.936102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:07.945056 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0d490074-9c07-44d4-b089-4364c2cdba16 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.444044 Nov 22 10:38:07.946482 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 300/610] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:07 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:07.951494 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:07.952314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:07.959358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.960176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.961779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:07.962295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:07.968197 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:07.978871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ddfcb600-234f-4e6c-a256-6546eb9e9e6a tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.488134 Nov 22 10:38:07.979581 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 311/611] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:07 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:07.998713 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:07.999583 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:08.006596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.007126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.008195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.008700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.060444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:08.067823 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-dc695e75-6e73-4c58-87dc-6cceb45671a0 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1270 microversion: 2.1 time: 0.120124 Nov 22 10:38:08.068411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 301/612] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:07 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:08.074473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:08.075442 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:08.082936 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.083389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.084272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.084894 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.760182 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:08.770206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:08.771740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:08.773243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-357b0b4e-1568-4c79-aeab-e86f0712cd9c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.780306 Nov 22 10:38:08.773812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 312/613] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:07 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:08.777903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:08.786878 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9a282fb5-70f4-4174-9e0d-60b9c519c187 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.717163 Nov 22 10:38:08.787554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 302/614] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:08 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:08.964110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:08.964730 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:08.971466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.971952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.972756 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:08.973554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:08.996085 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:08.996672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:09.003171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.004037 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.004849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.005460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.479746 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:09.492960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-74731989-e3ea-42cd-82b7-3d2bb4359e18 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.532586 Nov 22 10:38:09.493820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 313/615] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:08 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:09.498239 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:09.498846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:09.499342 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:09.509558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-98c2778d-a7fb-4fcd-9f50-591f9b276015 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.516490 Nov 22 10:38:09.510594 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 303/616] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:08 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:09.514481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.514949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.515811 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.516243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.608375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:09.617587 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ddad00fa-9bb0-46ce-94a4-5aa73de19dcb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1276 microversion: 2.1 time: 0.122857 Nov 22 10:38:09.627223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 314/617] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:09 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1276 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:09.654221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-ade5f652-b33c-4bd0-b558-e6c17237fbe1 req-cf1c45e9-d807-4dd4-b964-ddc2c99fc1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6811294-cd5f-4f0a-8884-4ee50b5b4e20", "tag": "e10e9677-3206-459d-8974-fe40b23be904"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:09.655865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:09.655865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:09.663931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-ade5f652-b33c-4bd0-b558-e6c17237fbe1 req-cf1c45e9-d807-4dd4-b964-ddc2c99fc1d3 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.664721 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-ade5f652-b33c-4bd0-b558-e6c17237fbe1 req-cf1c45e9-d807-4dd4-b964-ddc2c99fc1d3 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.682188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-ade5f652-b33c-4bd0-b558-e6c17237fbe1 req-cf1c45e9-d807-4dd4-b964-ddc2c99fc1d3 service nova] Creating event network-changed:e10e9677-3206-459d-8974-fe40b23be904 for instance d6811294-cd5f-4f0a-8884-4ee50b5b4e20 on hv-cinder-80403 Nov 22 10:38:09.689411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-ade5f652-b33c-4bd0-b558-e6c17237fbe1 req-cf1c45e9-d807-4dd4-b964-ddc2c99fc1d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038512 Nov 22 10:38:09.690623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 304/618] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:09.792472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:09.793041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:09.801188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.801854 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.802742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.803492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.807495 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:09.809873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:09.831135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.831610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:09.832567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:09.833178 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:10.282606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:10.291235 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:10.292617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:10.293643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:10.295602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-af331fb3-fb63-4420-ba42-a9b3bbc9c60c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.507191 Nov 22 10:38:10.296394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 315/619] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:09 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:10.300977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-474d9855-c8ac-487e-89d6-c0fce9afac7e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.499862 Nov 22 10:38:10.301766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 305/620] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:09 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:10.509940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:10.510600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:10.517386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:10.517840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:10.518643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:10.519483 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:10.527496 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:10.528462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:10.536069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:10.537302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:10.538633 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:10.539505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.306804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:11.318067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1c27191a-2785-4a00-aefe-4c35ef59f36f tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.812210 Nov 22 10:38:11.318649 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 316/621] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:10 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:11.323411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:11.324033 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:11.333409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.333862 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.335049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.335177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.341361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:11.350880 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1cb64666-aea5-4c15-823c-caba7f214e45 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1507 microversion: 2.1 time: 0.827126 Nov 22 10:38:11.352126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 306/622] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:10 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1507 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:11.359488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:11.361476 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:11.368494 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.369357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.370378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.370982 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.949211 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:11.956711 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-43efd4c3-68ce-46ba-b4ef-59711abb3366 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.636886 Nov 22 10:38:11.957312 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 317/623] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:11 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:11.961749 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:11.962360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:11.968654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.969101 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.969886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:11.970316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:11.988608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:11.998041 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:11.999545 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:12.000946 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4dcf4b6e-534d-4732-806c-3a50581162e2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.647560 Nov 22 10:38:12.001522 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 307/624] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:11 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:12.006264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-888854e1-6103-480e-9f31-fa27db540426 req-d3251b77-1717-4fbb-9ff5-9618e75f6a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "name": "network-vif-plugged", "status": "completed", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:12.008256 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:12.008256 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:12.016416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-888854e1-6103-480e-9f31-fa27db540426 req-d3251b77-1717-4fbb-9ff5-9618e75f6a6c service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.016971 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-888854e1-6103-480e-9f31-fa27db540426 req-d3251b77-1717-4fbb-9ff5-9618e75f6a6c service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.029108 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-888854e1-6103-480e-9f31-fa27db540426 req-d3251b77-1717-4fbb-9ff5-9618e75f6a6c service nova] Creating event network-vif-plugged:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:38:12.034486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-888854e1-6103-480e-9f31-fa27db540426 req-d3251b77-1717-4fbb-9ff5-9618e75f6a6c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Nov 22 10:38:12.035026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 308/625] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:12.336735 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:12.337430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:12.343829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.344518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.345034 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.345462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.351504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:12.360188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e0ce1763-9b1d-47bb-8e95-f958e87332e7 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.401807 Nov 22 10:38:12.361021 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 318/626] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:11 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:12.370104 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:12.370780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:12.377071 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.377599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.378453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.379577 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.511123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:12.526405 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-901138f3-1b3d-458b-9da8-86cc5d1f17af tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 200 len: 1465 microversion: 2.1 time: 0.159712 Nov 22 10:38:12.529904 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 319/627] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:12 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 1465 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:12.544421 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-af317039-2275-45d9-b0ca-f8a0abb4fe52 req-b8e0e837-ff3a-483b-bb57-65aa7eb51645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e561db-215b-4001-8ffb-bc4b093d8d0d", "tag": "162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:12.548774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:12.548774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:12.562006 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-af317039-2275-45d9-b0ca-f8a0abb4fe52 req-b8e0e837-ff3a-483b-bb57-65aa7eb51645 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.562441 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-af317039-2275-45d9-b0ca-f8a0abb4fe52 req-b8e0e837-ff3a-483b-bb57-65aa7eb51645 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.575893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-af317039-2275-45d9-b0ca-f8a0abb4fe52 req-b8e0e837-ff3a-483b-bb57-65aa7eb51645 service nova] Creating event network-changed:162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb for instance 91e561db-215b-4001-8ffb-bc4b093d8d0d on hv-cinder-80403 Nov 22 10:38:12.582660 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-af317039-2275-45d9-b0ca-f8a0abb4fe52 req-b8e0e837-ff3a-483b-bb57-65aa7eb51645 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050282 Nov 22 10:38:12.584110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 320/628] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:12.709368 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:12.716918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-61fd3db2-63b7-46ee-8c94-ce04c5f5364e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.384844 Nov 22 10:38:12.717534 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 309/629] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:12 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:12.976138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:12.977034 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:12.983554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.984085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:12.984866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:12.985264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.020092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.020650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.026795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.027247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.028112 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.028547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.292316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:13.297062 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:13.302952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:13.304494 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:13.305174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c8eff3c1-00d4-4d80-aba0-70d35fa984c6 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.334140 Nov 22 10:38:13.305789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 321/630] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:12 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:13.306047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-836da6b5-66bd-4f2d-be96-2a9010322755 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.289798 Nov 22 10:38:13.306598 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 310/631] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:13 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:13.378577 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.379423 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.386100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.386750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.387698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.388218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.545408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.546711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: ff495625-b409-4b63-93e2-68dbf32cd7c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.553487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.553930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.555040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.555546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.571415 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] HTTP exception thrown: Instance ff495625-b409-4b63-93e2-68dbf32cd7c5 could not be found. Nov 22 10:38:13.572198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Returning 404 to user: Instance ff495625-b409-4b63-93e2-68dbf32cd7c5 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:13.573326 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cd272485-39af-43ed-bb87-8eb32db0066f tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5" status: 404 len: 111 microversion: 2.1 time: 0.032301 Nov 22 10:38:13.577017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 311/632] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:13 2021] GET /compute/v2.1/servers/ff495625-b409-4b63-93e2-68dbf32cd7c5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:13.581929 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.582414 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.589566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.590026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.590832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.591286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.618916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:38:13.630321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:13.638778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b7b1b910-fcb1-4eea-ad2c-e31a307f2260 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.263971 Nov 22 10:38:13.639410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 322/633] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:13 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:13.710009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d5fd598b-d62b-4b82-98d0-77c43b1965bf tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 204 len: 0 microversion: 2.1 time: 0.131253 Nov 22 10:38:13.710942 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 312/634] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:38:13 2021] DELETE /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:38:13.720153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.720814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.727937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.728377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.729507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.730041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.736130 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:13.738330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:13.745402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.745864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:13.746663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:13.747079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.274698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.279221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.285667 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7991df85-d4a7-41af-be69-d0096879105e tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.569195 Nov 22 10:38:14.286286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 323/635] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:13 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:14.297862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7ee87263-6876-44bf-8bd9-d1b5f8d69086 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1358 microversion: 2.1 time: 0.567011 Nov 22 10:38:14.298533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 313/636] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:13 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1358 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:14.322439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:14.323366 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:14.326266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:14.327013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:14.329956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.330400 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.331212 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.331842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.333708 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.334155 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.335888 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.336530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.539814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.544085 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.548062 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-93a3cfb8-7d99-49ba-b4f2-0482c101b800 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.229478 Nov 22 10:38:14.548665 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 324/637] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:14 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:14.553550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.555078 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.556375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-335f2691-f7be-4be6-b501-41033777058f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.235336 Nov 22 10:38:14.556934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 314/638] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:14 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:38:14.603722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-39a9e9aa-10af-4706-8356-4fe5dc668c68 req-2903c588-1c7d-418b-b338-c7968a64357f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff495625-b409-4b63-93e2-68dbf32cd7c5", "name": "network-vif-deleted", "tag": "20f53f90-3a43-45e0-ab9e-ae35149604a8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:14.605377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:14.605377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:14.613241 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-39a9e9aa-10af-4706-8356-4fe5dc668c68 req-2903c588-1c7d-418b-b338-c7968a64357f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.613677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-39a9e9aa-10af-4706-8356-4fe5dc668c68 req-2903c588-1c7d-418b-b338-c7968a64357f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.626089 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-39a9e9aa-10af-4706-8356-4fe5dc668c68 req-2903c588-1c7d-418b-b338-c7968a64357f service nova] Creating event network-vif-deleted:20f53f90-3a43-45e0-ab9e-ae35149604a8 for instance ff495625-b409-4b63-93e2-68dbf32cd7c5 on hv-cinder-80403 Nov 22 10:38:14.631268 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-39a9e9aa-10af-4706-8356-4fe5dc668c68 req-2903c588-1c7d-418b-b338-c7968a64357f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031487 Nov 22 10:38:14.631933 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 325/639] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:14.655794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:14.656396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:14.663779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.664225 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.665017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:14.665445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:14.814310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:14.822131 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d490081f-0648-4243-9afb-651018241e54 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.170030 Nov 22 10:38:14.822745 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 315/640] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:14 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:15.303871 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.304579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:15.311561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.312024 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.312818 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.313274 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.316361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.317034 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:15.324001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.324454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.325246 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.325680 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.518165 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.521526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.528167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f7275c87-ec3a-4bd2-adc6-1dc55af7fec3 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.228708 Nov 22 10:38:15.528782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 326/641] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:15.529764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a7526e22-161a-4da7-9d83-042042d26acd tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1548 microversion: 2.1 time: 0.217135 Nov 22 10:38:15.535821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 316/642] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:15.548207 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.548826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:15.555599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.556039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.556844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.557280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.576610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.577211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:15.583369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.583866 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.585343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.585793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.777145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.781814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.785802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-22b40f2c-7c85-4bc2-99fd-7fcead352c3a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1548 microversion: 2.1 time: 0.240702 Nov 22 10:38:15.785802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 327/643] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:15.790676 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.791267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:15.800083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.801047 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.801594 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1627b25f-ac00-4c5b-8757-71b0faa31e20 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.238746 Nov 22 10:38:15.802322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 317/644] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:15.807851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:15.811371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:15.811371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:15.812560 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.813454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Searching by: {'deleted': False, 'project_id': '549a9a424a794c74836d8d862db06e25'} {{(pid=122857) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 22 10:38:15.814064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.814729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.822652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.822652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.822652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.823072 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:15.921273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.multi_cell_list [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122857) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 22 10:38:15.966643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.976488 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.978152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:15.979485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-09f64218-b475-4d4e-bac8-77ca38255151 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.192953 Nov 22 10:38:15.980744 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 328/645] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:15.985258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-dea5f15f-13d5-4283-91a0-0bbaa3ec2371 req-82b82b10-026c-4591-bcdd-f5c8e502799e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6811294-cd5f-4f0a-8884-4ee50b5b4e20", "name": "network-vif-plugged", "status": "completed", "tag": "e10e9677-3206-459d-8974-fe40b23be904"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:15.986926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:15.986926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:15.996319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-dea5f15f-13d5-4283-91a0-0bbaa3ec2371 req-82b82b10-026c-4591-bcdd-f5c8e502799e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:15.996902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-dea5f15f-13d5-4283-91a0-0bbaa3ec2371 req-82b82b10-026c-4591-bcdd-f5c8e502799e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.008699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-dea5f15f-13d5-4283-91a0-0bbaa3ec2371 req-82b82b10-026c-4591-bcdd-f5c8e502799e service nova] Creating event network-vif-plugged:e10e9677-3206-459d-8974-fe40b23be904 for instance d6811294-cd5f-4f0a-8884-4ee50b5b4e20 on hv-cinder-80403 Nov 22 10:38:16.014605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-dea5f15f-13d5-4283-91a0-0bbaa3ec2371 req-82b82b10-026c-4591-bcdd-f5c8e502799e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032471 Nov 22 10:38:16.016401 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 329/646] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:16.023415 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-47d77aa8-180d-4204-a3ba-4842e193e277 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219922 Nov 22 10:38:16.024258 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 318/647] 10.222.0.46 () {58 vars in 1124 bytes} [Mon Nov 22 10:38:15 2021] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:16.024773 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:16.025789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:16.036757 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:16.037665 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.037954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:16.038338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.039285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.039878 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.048520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.049241 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.050135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.050653 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.287432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:16.297006 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5edfee77-edf9-41a3-8a8e-9d4dcc3cdc67 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.279123 Nov 22 10:38:16.308035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 330/648] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:16 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:16.311406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:16.320159 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-18dcf719-d1db-42b2-ab97-b01ca9bbc711 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1548 microversion: 2.1 time: 0.289289 Nov 22 10:38:16.320751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 319/649] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:16 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1548 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:16.545804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:16.546432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:16.553752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.554735 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.554970 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.555434 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.721061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:16.729369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fef5c8c9-8e4a-422f-9df1-7cecb39eb367 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.187528 Nov 22 10:38:16.729965 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 331/650] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:16 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:16.821705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:16.822336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:16.829356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.829722 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.830525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:16.830954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:16.974267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:16.982060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5d047710-e1fa-4439-b045-3e811578d1c2 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.164281 Nov 22 10:38:16.982645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 320/651] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:16 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:16.998393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:16.999097 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:17.005801 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.006368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.007265 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.007704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.159082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:17.168997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:17.170518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:17.171821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5e094f18-c331-4bc8-8eae-1e1c73a3bdac tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.177277 Nov 22 10:38:17.172425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 332/652] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:16 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:17.315125 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:17.315766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:17.323357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.323869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.324686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.325145 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.491154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:17.499191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-35a211a3-6115-421d-b34b-65a25be5e415 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.187774 Nov 22 10:38:17.499856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 321/653] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:17 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:17.748698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:17.749451 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:17.757801 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.758359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.759344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.759825 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.909036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "509cbd20-2771-4c6d-aa89-772a09884988"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:17.911795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:17.920617 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.921075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.921930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:17.922362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:17.926016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:17.934812 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8e21d826-6024-48dd-8433-b356f4f6264d tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.190886 Nov 22 10:38:17.935396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 333/654] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:17 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:18.000391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:18.001358 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:18.009445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.009963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.010797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.011254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.163412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:18.170959 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9be7fe86-3202-499b-b987-25bb69c4cafc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.174531 Nov 22 10:38:18.171550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 334/655] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:17 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:18.193920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:18.194658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:18.200724 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.201147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.202024 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.202640 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.208136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-890f1a5d-ce3e-4d81-9163-ad59dc12cdeb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303592 Nov 22 10:38:18.208753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 322/656] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:38:17 2021] POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:18.346338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:18.355389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:18.356910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:18.358173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-37d7ee36-7321-4fc5-b0cd-4b437b1ff3fe tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.168472 Nov 22 10:38:18.358736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 335/657] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:18 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:18.521085 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:18.521824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:18.528363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.528818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.529599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.530031 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.672389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:18.679757 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d95e7518-6700-468d-8ba8-3d3d6531505f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1318 microversion: 2.1 time: 0.163352 Nov 22 10:38:18.680329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 323/658] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:18 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:18.953611 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:18.954360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:18.963643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.964315 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:18.965126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:18.965555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.106784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.114765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5d7d02cd-7e81-46ec-8830-15c09d4872f4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.164945 Nov 22 10:38:19.115342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 336/659] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:18 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:19.179559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:19.180190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:19.186922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.187278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.188119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.188655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.189042 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:19.189674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:19.196317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.196783 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.197614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.198075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.271017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'services' on Instance uuid 516b0499-a733-410c-9a0c-6e98ff43aba0 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:38:19.336719 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.344765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5231e41a-eeab-4839-b6b4-aa319f2dc20c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.159725 Nov 22 10:38:19.345511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 337/660] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:19 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:19.351944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7dbcc7b1-fab7-43f9-92b8-7f3dd3f8ab96 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments/942f00c7-df16-4c92-869a-84638695f205" status: 202 len: 0 microversion: 2.1 time: 0.176232 Nov 22 10:38:19.352500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 324/661] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:38:19 2021] DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments/942f00c7-df16-4c92-869a-84638695f205 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:38:19.376691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:19.377482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:19.384103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.384638 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.385473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.385902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.530866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.539856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.541530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.542721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3b80ebbe-2497-40b4-b81b-01a739d7e4c9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.169992 Nov 22 10:38:19.543279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 338/662] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:19 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:19.588193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-b5b3e98d-6f82-4724-8eae-4dee0325b0e6 req-ddff88b7-2940-4da2-b547-645a8486910b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "name": "network-vif-plugged", "status": "completed", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:19.589799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:19.589799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:19.598541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b5b3e98d-6f82-4724-8eae-4dee0325b0e6 req-ddff88b7-2940-4da2-b547-645a8486910b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.599213 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b5b3e98d-6f82-4724-8eae-4dee0325b0e6 req-ddff88b7-2940-4da2-b547-645a8486910b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.610829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-b5b3e98d-6f82-4724-8eae-4dee0325b0e6 req-ddff88b7-2940-4da2-b547-645a8486910b service nova] Creating event network-vif-plugged:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:38:19.616214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-b5b3e98d-6f82-4724-8eae-4dee0325b0e6 req-ddff88b7-2940-4da2-b547-645a8486910b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033034 Nov 22 10:38:19.617275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 325/663] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:19.697873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:19.698492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:19.705023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.705474 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.706258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:19.706685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:19.845574 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:19.854915 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1c5233d0-b2a5-4d1f-a1d7-bfcd07e1fbf0 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1508 microversion: 2.1 time: 0.160952 Nov 22 10:38:19.855531 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 339/664] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:19 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:20.133339 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:20.134052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:20.141379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.141819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.142978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.143465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.341397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:20.349877 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e767f6db-e464-4c67-99ea-3d4cdf8a97f0 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.221241 Nov 22 10:38:20.350470 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 326/665] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:20 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:20.363028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:20.363875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:20.370974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.371709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.372874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.373293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.515849 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:20.523406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f7aace0d-8a6e-4e39-b56c-6cdf8f3b2dad tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.164474 Nov 22 10:38:20.524025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 340/666] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:20 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:20.561324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:20.562009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:20.568068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.568610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.569838 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:20.570273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:20.718745 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:20.728546 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:20.730037 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:20.731243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7a45f91c-075b-4a22-8102-0a3145a97eee tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.173701 Nov 22 10:38:20.731835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 327/667] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:20 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:21.367269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:21.367903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:21.374900 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.375350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.376201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.376639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.540918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:21.541971 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:21.544902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:21.549118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.549576 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.550422 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.551053 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.553122 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5fd5d413-0ad1-4d5d-9a2d-3f5af5b69e36 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.190008 Nov 22 10:38:21.553790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 341/668] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:21 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:21.637614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-ec3ff1cc-38c4-4883-b56d-c359cc323f3b req-8b1ff44c-ba8a-494d-b9a2-25ec96e11b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e561db-215b-4001-8ffb-bc4b093d8d0d", "name": "network-vif-plugged", "status": "completed", "tag": "162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:21.639366 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:21.639366 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:21.646914 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ec3ff1cc-38c4-4883-b56d-c359cc323f3b req-8b1ff44c-ba8a-494d-b9a2-25ec96e11b13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.647350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ec3ff1cc-38c4-4883-b56d-c359cc323f3b req-8b1ff44c-ba8a-494d-b9a2-25ec96e11b13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.659452 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-ec3ff1cc-38c4-4883-b56d-c359cc323f3b req-8b1ff44c-ba8a-494d-b9a2-25ec96e11b13 service nova] Creating event network-vif-plugged:162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb for instance 91e561db-215b-4001-8ffb-bc4b093d8d0d on hv-cinder-80403 Nov 22 10:38:21.665364 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-ec3ff1cc-38c4-4883-b56d-c359cc323f3b req-8b1ff44c-ba8a-494d-b9a2-25ec96e11b13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031559 Nov 22 10:38:21.665956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 342/669] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:21.718357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:21.726343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e52c8f90-ad0a-47ee-b3e2-3e9cf3da5cdf tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.189376 Nov 22 10:38:21.726902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 328/670] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:21 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:21.751579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:21.752337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:21.760989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.761817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.763636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:21.764265 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:21.939111 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:21.948527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:21.950010 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:21.951181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-532550ee-7fd7-4bf2-b75a-f99bba01f9ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.204295 Nov 22 10:38:21.951788 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 343/671] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:21 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:22.570694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:22.571321 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:22.578920 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.579287 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:22.580354 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.580791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:22.720418 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:22.729327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1eea430e-2c31-4a7b-adb8-ac66f3c2dc91 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.162423 Nov 22 10:38:22.729930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 329/672] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:22 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:22.743550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:22.744244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:22.750736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.751183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:22.752021 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.752445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:22.894637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:22.904514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f665dc4c-105c-4333-83a3-b33119ef351b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.164823 Nov 22 10:38:22.905333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 344/673] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:22 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:22.970188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:22.970797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:22.977770 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.978223 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:22.979056 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:22.979485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:23.119327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:23.127778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:23.129250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:23.130416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-699a2010-bd5c-463f-9a7f-6f855c663b2f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.164048 Nov 22 10:38:23.131006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 330/674] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:22 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:23.746940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:23.747535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:23.754137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:23.754590 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:23.755394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:23.755870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:23.922191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:23.922825 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:23.929993 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:23.930516 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:23.931318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:23.931767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:24.003016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:24.011137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9ffa6ee2-fbb6-4c6f-af13-ae959bd129fd tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1522 microversion: 2.1 time: 0.268072 Nov 22 10:38:24.012060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 345/675] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:23 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:24.150046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:24.150806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:24.157080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:24.157557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:24.158490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:24.158797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:24.169034 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:24.180059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-69d25bac-40c7-45e4-b2ea-483fe21556ed tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.261536 Nov 22 10:38:24.185603 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 331/676] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:23 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:24.381824 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:24.396458 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:24.398229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:24.399940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3cdbc791-90f2-4644-a688-2be65fd5e5d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1806 microversion: 2.20 time: 0.254541 Nov 22 10:38:24.411410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 346/677] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:24 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1806 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:38:24.624075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-567b7617-1618-4374-8786-649b9141388d req-4d926410-a191-4452-8058-dabac58d66f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60ede0be-83f5-416b-8ba7-216691a79cbc", "name": "network-vif-deleted", "tag": "e7b68ff2-ecd7-4e74-81b4-cf38071ef393"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:24.625918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:24.625918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:24.634166 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-567b7617-1618-4374-8786-649b9141388d req-4d926410-a191-4452-8058-dabac58d66f0 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:24.634606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-567b7617-1618-4374-8786-649b9141388d req-4d926410-a191-4452-8058-dabac58d66f0 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:24.647647 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-567b7617-1618-4374-8786-649b9141388d req-4d926410-a191-4452-8058-dabac58d66f0 service nova] Creating event network-vif-deleted:e7b68ff2-ecd7-4e74-81b4-cf38071ef393 for instance 60ede0be-83f5-416b-8ba7-216691a79cbc on hv-cinder-80403 Nov 22 10:38:24.655233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-567b7617-1618-4374-8786-649b9141388d req-4d926410-a191-4452-8058-dabac58d66f0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038533 Nov 22 10:38:24.659839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 332/678] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:25.029677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:25.030342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:25.038538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.039033 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.039889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.040318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.078241 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.078790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.079391 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lazy-loading 'fault' on Instance uuid 60ede0be-83f5-416b-8ba7-216691a79cbc {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:38:25.128780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b0cecac44354a5aa1e9e517f7f6e813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd8cc91c540eda175b762b2cc6d9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:25.137380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e6bea888-3efc-4391-902f-5dbb593e2fc4 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 200 len: 1311 microversion: 2.1 time: 0.112378 Nov 22 10:38:25.137963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 347/679] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:25 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:25.203615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:25.204331 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:25.211629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.212101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.212876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.213303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.358474 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:25.366743 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0cab5e32-7d66-4638-9e21-121153f3b58d tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1318 microversion: 2.1 time: 0.167670 Nov 22 10:38:25.367334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 333/680] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:25 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:25.418431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:25.419046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:25.425356 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.426062 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.427386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:25.427927 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:25.603289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:25.613716 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:25.615429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:25.616851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db696123-d236-4067-bb4c-9bc5746caaa2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1793 microversion: 2.20 time: 0.202241 Nov 22 10:38:25.617431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 348/681] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:38:25 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1793 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:38:26.155092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:26.155753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] [instance: 60ede0be-83f5-416b-8ba7-216691a79cbc] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:26.162669 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.163355 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.164263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.164703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.179475 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] HTTP exception thrown: Instance 60ede0be-83f5-416b-8ba7-216691a79cbc could not be found. Nov 22 10:38:26.180122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] Returning 404 to user: Instance 60ede0be-83f5-416b-8ba7-216691a79cbc could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:26.181063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2e5e7bee-dc84-4a24-afbe-8277c1133771 tempest-ServerRescueNegativeTestJSON-1694654711 tempest-ServerRescueNegativeTestJSON-1694654711-project] 10.222.0.46 "GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc" status: 404 len: 111 microversion: 2.1 time: 0.029943 Nov 22 10:38:26.181652 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 334/682] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:26 2021] GET /compute/v2.1/servers/60ede0be-83f5-416b-8ba7-216691a79cbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:26.390530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:26.391216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:26.399305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.399520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.400227 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.400674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.620674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:26.628665 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-89abc6f8-a4e8-483a-8822-e075f50e6f94 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1508 microversion: 2.1 time: 0.245413 Nov 22 10:38:26.629398 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 349/683] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:26 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:26.831904 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c211346f-f2a9-47ec-981e-700282583186 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:26.843057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c211346f-f2a9-47ec-981e-700282583186 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.843867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c211346f-f2a9-47ec-981e-700282583186 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.882329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c211346f-f2a9-47ec-981e-700282583186 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Going to try to stop instance {{(pid=122857) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 10:38:26.962189 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:26.963013 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:26.974742 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c211346f-f2a9-47ec-981e-700282583186 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 202 len: 0 microversion: 2.1 time: 0.148539 Nov 22 10:38:26.976629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 335/684] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:38:26 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:38:26.982091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.982846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.984079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:26.984847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:26.992210 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:26.993255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:27.008115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:27.008115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:27.008115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:27.008115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:27.394992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:27.402513 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:27.409557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d4c2c917-2518-4e43-9246-762b98130f58 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1594 microversion: 2.1 time: 0.453458 Nov 22 10:38:27.410565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 350/685] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:26 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1594 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:27.445456 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b57af211-3713-4286-ad0f-d8ba5dc9cd40 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.462033 Nov 22 10:38:27.446065 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 336/686] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:26 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:28.133059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f4fcf54-4197-4377-b244-9a10c2aacfeb"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:28.134202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:28.140852 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:28.141576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:28.142728 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:28.143162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:28.464597 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:28.465892 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:28.475279 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:28.478542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:28.480705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:28.481764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:28.491989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8b64c94b-6400-4b2f-a28b-2460238c987c tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "POST /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363058 Nov 22 10:38:28.497553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 351/687] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:38:28 2021] POST /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:28.788655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:28.798049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3bbb016c-d509-4a3a-8ad0-e441b07a595f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.338040 Nov 22 10:38:28.804408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 337/688] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:28 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:29.822774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:29.824420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:29.845379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:29.847190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:29.850890 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:29.851700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:29.933357 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-b89afa23-6f9a-47c3-93f4-44c94d3ef57c req-d2be5751-b854-469c-8766-2700898911b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:29.937818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:29.937818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:29.960185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b89afa23-6f9a-47c3-93f4-44c94d3ef57c req-d2be5751-b854-469c-8766-2700898911b8 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:29.960801 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-b89afa23-6f9a-47c3-93f4-44c94d3ef57c req-d2be5751-b854-469c-8766-2700898911b8 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:29.976370 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-b89afa23-6f9a-47c3-93f4-44c94d3ef57c req-d2be5751-b854-469c-8766-2700898911b8 service nova] Creating event network-changed:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:38:29.983185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-b89afa23-6f9a-47c3-93f4-44c94d3ef57c req-d2be5751-b854-469c-8766-2700898911b8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052782 Nov 22 10:38:29.985499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 338/689] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:38:30.398019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:30.416715 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f2679bf7-8ba6-4831-a8a3-dcbd42f7c1c1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.604915 Nov 22 10:38:30.435446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 352/690] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:29 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:31.437535 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:31.439937 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:31.452177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:31.452917 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:31.453898 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:31.454484 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:31.677990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:31.699229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e5e5f324-aa27-4f4e-95c2-edb0b3fe1ade tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.267245 Nov 22 10:38:31.700208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 339/691] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:31 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:31.768471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-225268498"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:31.769042 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:31.775967 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:31.776430 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:31.777230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:31.777667 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:31.930014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.network.security_group_api [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Adding security group cb9f1571-aa6d-43fe-a22d-0d0ac84f7907 to port 326eedf5-8a3e-4e3a-887c-a2d57a212dc8 Nov 22 10:38:32.341789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7a897341-693b-4bb3-9725-29985b31358d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action" status: 202 len: 0 microversion: 2.1 time: 0.576993 Nov 22 10:38:32.342591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 353/692] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:38:31 2021] POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:38:32.351354 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:32.357631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-a0aee567-327f-404b-a3b0-46ec5b9900ce req-85c770d8-5eb5-4448-a20b-823b19f38c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:32.359527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:32.359527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:32.361144 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:32.382035 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:32.382684 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:32.383324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:32.386439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-a0aee567-327f-404b-a3b0-46ec5b9900ce req-85c770d8-5eb5-4448-a20b-823b19f38c9e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:32.387042 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-a0aee567-327f-404b-a3b0-46ec5b9900ce req-85c770d8-5eb5-4448-a20b-823b19f38c9e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:32.387578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:32.399260 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-a0aee567-327f-404b-a3b0-46ec5b9900ce req-85c770d8-5eb5-4448-a20b-823b19f38c9e service nova] Creating event network-changed:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:38:32.405210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-a0aee567-327f-404b-a3b0-46ec5b9900ce req-85c770d8-5eb5-4448-a20b-823b19f38c9e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051900 Nov 22 10:38:32.406055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 354/693] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:32.586782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3a8e1e10-e9fa-417e-be04-5d2d05942261 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Action: 'create', calling method: .version_select at 0x7f1a59d8e3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1785375412"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:32.737542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:32.747183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ca004f14-8ed2-4faf-a20b-baf88e501a13 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1758 microversion: 2.1 time: 0.400263 Nov 22 10:38:32.747787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 340/694] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:32 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1758 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:32.752278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:32.753194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:32.767416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:32.768337 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:32.769990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:32.771594 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:32.980501 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3a8e1e10-e9fa-417e-be04-5d2d05942261 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.573117 Nov 22 10:38:32.988673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 355/695] 10.222.0.46 () {60 vars in 1154 bytes} [Mon Nov 22 10:38:32 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 582 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 10:38:32.994645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e1da641b-fd3f-4a3b-b7ad-8a18a4760ba4 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a593dd1f0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:33.047766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:33.056376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-886a2d3e-66e7-4d56-8b8d-5b6ea0807bc7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.307291 Nov 22 10:38:33.067249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 341/696] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:32 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:33.067899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e1da641b-fd3f-4a3b-b7ad-8a18a4760ba4 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 200 len: 345 microversion: 2.1 time: 0.073826 Nov 22 10:38:33.067899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 356/697] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:38:32 2021] GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:34.075038 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:34.075688 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:34.076859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-aef10b7e-0421-4e94-9938-569bea8dd8c3 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a593c6820>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:34.082564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:34.083020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:34.083878 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:34.084925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:34.140168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-aef10b7e-0421-4e94-9938-569bea8dd8c3 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 200 len: 346 microversion: 2.1 time: 0.067310 Nov 22 10:38:34.140992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 357/698] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:38:34 2021] GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:34.152693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3027dcbd-54db-4d45-9b80-462c2b07eba8 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Action: 'create', calling method: .version_select at 0x7f1a59425f70>, body: {"snapshot": {"volume_id": "8191117f-c594-4f43-93a5-4b2884ff5c24", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1666940540"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:34.250640 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:34.259949 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5f0b2315-e28a-4415-bb73-1beff84ef589 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.188593 Nov 22 10:38:34.260545 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 342/699] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:34 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:34.332426 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3027dcbd-54db-4d45-9b80-462c2b07eba8 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.183696 Nov 22 10:38:34.333140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 358/700] 10.222.0.46 () {60 vars in 1161 bytes} [Mon Nov 22 10:38:34 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:34.343235 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bd121daa-f272-4030-b161-48e2d308df37 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a5976c5e0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:34.378567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bd121daa-f272-4030-b161-48e2d308df37 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.038968 Nov 22 10:38:34.379210 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 343/701] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:34 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:34.389380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-55eab3f5-a2c2-4c3f-aa36-e2a9602a8622 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a593dd670>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:34.429779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-55eab3f5-a2c2-4c3f-aa36-e2a9602a8622 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044083 Nov 22 10:38:34.430364 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 359/702] 10.222.0.46 () {58 vars in 1139 bytes} [Mon Nov 22 10:38:34 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:34.440694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5af2dc8a-9dcf-4388-9d34-d1459d488213 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a59323700>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:34.469696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5af2dc8a-9dcf-4388-9d34-d1459d488213 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.032702 Nov 22 10:38:34.470266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 344/703] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:34 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:35.278513 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:35.279220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:35.286579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:35.287036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:35.287847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:35.288305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:35.429025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:35.437057 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-316dd2bf-3211-4179-8799-355645d101f3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.162780 Nov 22 10:38:35.437794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 360/704] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:35 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:35.482589 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3359252c-114c-456a-be50-de761ea2b55a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a592b4b80>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:35.513050 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3359252c-114c-456a-be50-de761ea2b55a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.034582 Nov 22 10:38:35.513619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 345/705] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:35 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:36.455551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:36.456221 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:36.464017 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:36.464471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:36.465276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:36.465707 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:36.525940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-187736cf-31be-4d14-8838-d9423b9a978e tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a59323040>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:36.554892 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-187736cf-31be-4d14-8838-d9423b9a978e tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.033385 Nov 22 10:38:36.555511 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 346/706] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:36 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:36.605879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:36.613429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-88c6cb4f-a3bf-4f75-9beb-1a591526111b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.161772 Nov 22 10:38:36.613990 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 361/707] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:36 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:37.568269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3adaefdf-5305-4904-b301-173113b1c62b tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a5942ae50>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:37.596767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3adaefdf-5305-4904-b301-173113b1c62b tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.032806 Nov 22 10:38:37.597699 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 347/708] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:37 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:37.631260 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:37.631865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:37.638807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:37.639258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:37.640074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:37.640503 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:37.784578 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:37.792200 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-43525ceb-62cf-4ada-9c39-c8d14f4e5031 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.164817 Nov 22 10:38:37.792785 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 362/709] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:37 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:38.610188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-74e8f834-caca-44f9-a411-ec25dfd28230 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a592f9ee0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:38.640625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-74e8f834-caca-44f9-a411-ec25dfd28230 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 288 microversion: 2.1 time: 0.035083 Nov 22 10:38:38.641221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 348/710] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:38 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:38.651708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e53785c2-e390-4ed0-9f78-701ff0deedaf tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a59d8eee0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:38.713620 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e53785c2-e390-4ed0-9f78-701ff0deedaf tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 202 len: 0 microversion: 2.1 time: 0.065759 Nov 22 10:38:38.714295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 363/711] 10.222.0.46 () {58 vars in 1253 bytes} [Mon Nov 22 10:38:38 2021] DELETE /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:38:38.723076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bf7f3e4b-eae5-414f-b019-50c92d0de6de tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a5942a790>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:38.752539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bf7f3e4b-eae5-414f-b019-50c92d0de6de tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 200 len: 287 microversion: 2.1 time: 0.033549 Nov 22 10:38:38.753125 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 349/712] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:38 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:38.809966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:38.810597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:38.816909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:38.817371 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:38.818179 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:38.818618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:38.957222 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:38.965681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c009c575-37be-4eb8-93ad-20eccf8ccfa1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.159753 Nov 22 10:38:38.966260 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 364/713] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:38 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:39.406956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.407693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:39.415831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.416264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:39.417056 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.417448 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:39.504682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'services' on Instance uuid 91e561db-215b-4001-8ffb-bc4b093d8d0d {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:38:39.589700 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5eae3786-534a-4004-9693-79f26534f947 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments/0f4fcf54-4197-4377-b244-9a10c2aacfeb" status: 202 len: 0 microversion: 2.1 time: 0.186670 Nov 22 10:38:39.590373 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 350/714] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:38:39 2021] DELETE /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments/0f4fcf54-4197-4377-b244-9a10c2aacfeb => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:38:39.599695 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.600700 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:39.607013 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.608133 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:39.609597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.610363 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:39.653055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6e37ede5-27b2-4549-911c-4690eaf987d3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057983 Nov 22 10:38:39.654172 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 365/715] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:38:39 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:39.766287 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0e1613db-f438-4220-bd08-e7127f852288 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a5942a310>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.791011 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-0e1613db-f438-4220-bd08-e7127f852288 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] HTTP exception thrown: Snapshot 3c82ef45-cda6-457a-9dbf-5c56c44eeb0c could not be found. Nov 22 10:38:39.791605 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0e1613db-f438-4220-bd08-e7127f852288 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Returning 404 to user: Snapshot 3c82ef45-cda6-457a-9dbf-5c56c44eeb0c could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:39.792475 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0e1613db-f438-4220-bd08-e7127f852288 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c" status: 404 len: 111 microversion: 2.1 time: 0.030796 Nov 22 10:38:39.793052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 351/716] 10.222.0.46 () {58 vars in 1250 bytes} [Mon Nov 22 10:38:39 2021] GET /compute/v2.1/os-snapshots/3c82ef45-cda6-457a-9dbf-5c56c44eeb0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:39.801305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ddd79439-dbf3-4329-bf2e-9add5883d119 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a593ac940>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.869340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ddd79439-dbf3-4329-bf2e-9add5883d119 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 202 len: 0 microversion: 2.1 time: 0.071499 Nov 22 10:38:39.870150 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 366/717] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:38:39 2021] DELETE /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:38:39.878804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d00748ae-34e4-4a20-9fd3-031ee66b55ef tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a592f9af0>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.937623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d00748ae-34e4-4a20-9fd3-031ee66b55ef tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 200 len: 345 microversion: 2.1 time: 0.062431 Nov 22 10:38:39.938176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 352/718] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:38:39 2021] GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:39.983651 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:39.984198 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:39.990432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.990897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:39.991633 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:39.992810 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:40.137019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:40.144718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-99275041-7fed-4282-a3c0-e4aca9b7791c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.165073 Nov 22 10:38:40.145293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 367/719] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:39 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:40.666065 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:40.667185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:40.673982 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:40.674431 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:40.675206 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:40.675638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:40.709403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-147dd29c-b9ec-4064-b1f2-1f128d77d68f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047264 Nov 22 10:38:40.710013 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 353/720] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:38:40 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:40.952828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d08e7c6b-6a2b-4565-b4ec-55f48b80d053 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a59425f70>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:40.981532 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-d08e7c6b-6a2b-4565-b4ec-55f48b80d053 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] HTTP exception thrown: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. Nov 22 10:38:40.982121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d08e7c6b-6a2b-4565-b4ec-55f48b80d053 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Returning 404 to user: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:40.982948 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d08e7c6b-6a2b-4565-b4ec-55f48b80d053 tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 404 len: 109 microversion: 2.1 time: 0.033971 Nov 22 10:38:40.983494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 368/721] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:38:40 2021] GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:40.997758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3ff8a3f4-8f33-4efb-96c9-3beda762f65c tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a592b4790>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:41.027186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-3ff8a3f4-8f33-4efb-96c9-3beda762f65c tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] HTTP exception thrown: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. Nov 22 10:38:41.027830 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3ff8a3f4-8f33-4efb-96c9-3beda762f65c tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Returning 404 to user: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:41.028668 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3ff8a3f4-8f33-4efb-96c9-3beda762f65c tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 404 len: 109 microversion: 2.1 time: 0.034582 Nov 22 10:38:41.029228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 354/722] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:38:40 2021] DELETE /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:41.037374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bff59345-065e-4b49-a66a-b62a55bac52a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Calling method '.version_select at 0x7f1a5938e550>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:41.065663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-bff59345-065e-4b49-a66a-b62a55bac52a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] HTTP exception thrown: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. Nov 22 10:38:41.066352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bff59345-065e-4b49-a66a-b62a55bac52a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] Returning 404 to user: Volume 8191117f-c594-4f43-93a5-4b2884ff5c24 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:41.067192 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bff59345-065e-4b49-a66a-b62a55bac52a tempest-VolumesSnapshotsTestJSON-370235033 tempest-VolumesSnapshotsTestJSON-370235033-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24" status: 404 len: 109 microversion: 2.1 time: 0.033539 Nov 22 10:38:41.067793 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 369/723] 10.222.0.46 () {58 vars in 1244 bytes} [Mon Nov 22 10:38:41 2021] GET /compute/v2.1/os-volumes/8191117f-c594-4f43-93a5-4b2884ff5c24 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:41.163797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:41.164428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:41.171727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:41.172169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:41.172959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:41.173392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:41.314706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:41.322588 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c5e86d38-59f9-4320-9236-f78cb5a53166 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.162959 Nov 22 10:38:41.323148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 355/724] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:41 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:41.721319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:41.722605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:41.729511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:41.729966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:41.730768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:41.731194 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:41.763140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4023cf88-def1-4553-a81a-2f7ac48aeeb1 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045802 Nov 22 10:38:41.763947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 370/725] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:38:41 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:38:42.340323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:42.340938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:42.347853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:42.348420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:42.349102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:42.349539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:42.486880 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:42.495079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3075a616-cf2f-402a-a840-0d444d361d41 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1675 microversion: 2.1 time: 0.158606 Nov 22 10:38:42.495708 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 356/726] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:42 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:42.961129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:42.961798 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:42.968741 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:42.969285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:42.970138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:42.970671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:42.996813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:38:43.078457 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2a8a2c84-8ff7-41d7-8383-aad79887eea4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 204 len: 0 microversion: 2.1 time: 0.121003 Nov 22 10:38:43.079248 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 371/727] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:38:42 2021] DELETE /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:38:43.088817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:43.089718 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:43.096191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.096646 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.097773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.098205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.263049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:43.272234 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-98328d18-fc24-4c97-8931-0dc862a24611 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1514 microversion: 2.1 time: 0.187611 Nov 22 10:38:43.272867 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 357/728] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:43 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:43.514383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:43.515200 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:43.531267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.531867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.532732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.535163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.651080 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8405d05-05d3-4a9b-b721-254286d36d8c", "device": "/dev/sdb"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:43.652814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:43.659765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.660209 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.661118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.661675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.698970 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:43.709747 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-76aa589c-d132-4a89-a023-b0814438bebb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1652 microversion: 2.1 time: 0.200375 Nov 22 10:38:43.715892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 372/729] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:43 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1652 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:38:43.729123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d2baa640-f3d6-4f7a-a93a-c34f2190abc3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:43.735692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2baa640-f3d6-4f7a-a93a-c34f2190abc3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.736333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2baa640-f3d6-4f7a-a93a-c34f2190abc3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.763688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d2baa640-f3d6-4f7a-a93a-c34f2190abc3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Going to try to start instance {{(pid=122858) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 10:38:43.820781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d2baa640-f3d6-4f7a-a93a-c34f2190abc3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action" status: 202 len: 0 microversion: 2.1 time: 0.096425 Nov 22 10:38:43.821892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 373/730] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:38:43 2021] POST /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:38:43.840950 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:43.841682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:43.849039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.849613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.856851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:43.857413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:43.963177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cd69b4f0-379c-4264-94f1-1e520265ed62 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "POST /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317450 Nov 22 10:38:43.967984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 358/731] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:38:43 2021] POST /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:38:44.033988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:44.043440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b8f84205-9aeb-4a8f-a6f7-50e91a69d22b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1661 microversion: 2.1 time: 0.207931 Nov 22 10:38:44.044299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 374/732] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:43 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1661 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:44.294789 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:44.295838 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:44.303113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:44.303577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:44.304574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:44.305166 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:44.810093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:44.818636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7863b126-1646-4172-a7fd-a12d29ae4745 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1514 microversion: 2.1 time: 0.531055 Nov 22 10:38:44.819197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 359/733] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:44 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1514 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:45.061780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:45.062413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:45.069297 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:45.069872 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:45.070705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:45.071125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:45.225013 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:45.236061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2ed58fdd-ae44-4eb9-82b1-620bda3ba990 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1661 microversion: 2.1 time: 0.177851 Nov 22 10:38:45.236913 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 375/734] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:45 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1661 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:45.839101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:45.839800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:45.847588 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:45.848581 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:45.849922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:45.850773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:46.152487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-ea85e4c1-767e-4738-9ba7-cc72d95f489e req-cdcc5eea-b4c1-49e2-9ecc-997f3406359a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e561db-215b-4001-8ffb-bc4b093d8d0d", "name": "network-vif-deleted", "tag": "162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:46.154167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:46.154167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:38:46.159236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:46.176727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e52068de-bd12-4b03-bfc3-80078eac8602 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 200 len: 1514 microversion: 2.1 time: 0.336979 Nov 22 10:38:46.181958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 360/735] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:45 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 1514 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:46.201979 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ea85e4c1-767e-4738-9ba7-cc72d95f489e req-cdcc5eea-b4c1-49e2-9ecc-997f3406359a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:46.202492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ea85e4c1-767e-4738-9ba7-cc72d95f489e req-cdcc5eea-b4c1-49e2-9ecc-997f3406359a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:46.230536 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-ea85e4c1-767e-4738-9ba7-cc72d95f489e req-cdcc5eea-b4c1-49e2-9ecc-997f3406359a service nova] Creating event network-vif-deleted:162efafc-5fbe-4bfc-a1b2-e10fdfd5a7eb for instance 91e561db-215b-4001-8ffb-bc4b093d8d0d on hv-cinder-80403 Nov 22 10:38:46.237342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-ea85e4c1-767e-4738-9ba7-cc72d95f489e req-cdcc5eea-b4c1-49e2-9ecc-997f3406359a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094358 Nov 22 10:38:46.239932 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 376/736] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:46.256416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:46.256416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:46.262582 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:46.263216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:46.264223 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:46.265087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:46.442356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:46.452232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6c291739-4889-4404-99a3-c3a577f792ea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1665 microversion: 2.1 time: 0.201250 Nov 22 10:38:46.453156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 361/737] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:46 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1665 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:47.199218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:47.199923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 91e561db-215b-4001-8ffb-bc4b093d8d0d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:47.207121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:47.207711 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:47.208567 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:47.208999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:47.224041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Instance 91e561db-215b-4001-8ffb-bc4b093d8d0d could not be found. Nov 22 10:38:47.224648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 404 to user: Instance 91e561db-215b-4001-8ffb-bc4b093d8d0d could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:47.225487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bde67d33-e9a1-4621-abef-70d1e20c2971 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d" status: 404 len: 111 microversion: 2.1 time: 0.031962 Nov 22 10:38:47.226168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 377/738] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:47 2021] GET /compute/v2.1/servers/91e561db-215b-4001-8ffb-bc4b093d8d0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:48.404086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:48.404625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:48.411630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:48.412283 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:48.413075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:48.413503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:48.439340 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:38:48.535302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4e5b0cba-aa56-416d-8622-b4fbbd01bf6e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 204 len: 0 microversion: 2.1 time: 0.134591 Nov 22 10:38:48.536284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 362/739] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:38:48 2021] DELETE /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:38:48.546056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:48.546660 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:48.553792 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:48.554228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:48.555023 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:48.555432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:48.704595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:48.712373 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d16eb8fa-d1f7-46ad-8563-d17e3dafa739 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1513 microversion: 2.1 time: 0.170702 Nov 22 10:38:48.712958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 378/740] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:48 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:49.737178 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:49.737965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:49.745036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:49.745485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:49.746280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:49.746711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:49.901759 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:49.911267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1c548ec5-254c-4694-8118-8b0c3b03f120 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1513 microversion: 2.1 time: 0.178681 Nov 22 10:38:49.912063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 363/741] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:49 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:50.930675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:50.932017 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:50.939886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:50.940348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:50.941230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:50.941624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:51.173446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:51.182217 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-345ca5e7-e362-44a9-a963-8aad4703e0a3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 200 len: 1513 microversion: 2.1 time: 0.255466 Nov 22 10:38:51.182805 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 379/742] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:50 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:51.307064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-3d0a2048-449c-49e9-b98a-833d2c796acd req-862a78f1-4b08-447c-917e-9523805aff46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef620a8a-291f-484a-aacb-17f63097f482", "name": "network-vif-deleted", "tag": "8fcdd3ad-842b-4a16-9297-c14e81508bca"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:38:51.307926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:38:51.307926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:38:51.316794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3d0a2048-449c-49e9-b98a-833d2c796acd req-862a78f1-4b08-447c-917e-9523805aff46 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:51.318122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3d0a2048-449c-49e9-b98a-833d2c796acd req-862a78f1-4b08-447c-917e-9523805aff46 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:51.329518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-3d0a2048-449c-49e9-b98a-833d2c796acd req-862a78f1-4b08-447c-917e-9523805aff46 service nova] Creating event network-vif-deleted:8fcdd3ad-842b-4a16-9297-c14e81508bca for instance ef620a8a-291f-484a-aacb-17f63097f482 on hv-cinder-80403 Nov 22 10:38:51.334946 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-3d0a2048-449c-49e9-b98a-833d2c796acd req-862a78f1-4b08-447c-917e-9523805aff46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 Nov 22 10:38:51.338852 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 364/743] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:38:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:38:52.201671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:52.202513 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: ef620a8a-291f-484a-aacb-17f63097f482] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:52.210706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.211158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.212058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.212860 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.230191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Instance ef620a8a-291f-484a-aacb-17f63097f482 could not be found. Nov 22 10:38:52.230792 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 404 to user: Instance ef620a8a-291f-484a-aacb-17f63097f482 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:38:52.231634 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-42e4c3f3-7561-48a0-a6ea-778e14f301cb tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482" status: 404 len: 111 microversion: 2.1 time: 0.034842 Nov 22 10:38:52.232273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 380/744] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:52 2021] GET /compute/v2.1/servers/ef620a8a-291f-484a-aacb-17f63097f482 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:38:52.242674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:52.243371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:52.252650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.253112 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.253909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.254343 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.290311 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:38:52.376596 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-75b03b54-74e3-4aa3-9493-4f44b0bd331f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 204 len: 0 microversion: 2.1 time: 0.138529 Nov 22 10:38:52.377297 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 365/745] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:38:52 2021] DELETE /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:38:52.385170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:52.385792 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:52.393905 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.394485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.395977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:52.396671 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:52.555939 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:52.564041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-55eaa2ec-984f-4787-b523-f5223b461697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.182539 Nov 22 10:38:52.564675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 381/746] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:52 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:53.583157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:53.583897 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:53.593250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:53.593903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:53.595224 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:53.595739 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:53.745930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:53.755933 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-57148e0e-1782-4398-8cb8-3ef16fe22a81 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.177620 Nov 22 10:38:53.756696 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 366/747] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:53 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:54.774742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:54.775443 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:54.782819 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:54.783267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:54.784084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:54.784560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:54.940879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:54.950800 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-dde56127-289c-4d12-a3f7-0ef2f5a13211 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.180086 Nov 22 10:38:54.951380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 382/748] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:54 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:55.970082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:55.970082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:55.977053 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:55.977501 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:55.978394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:55.978729 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:56.130588 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:56.142488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-01966eaf-e488-479a-8ff8-44ace4a59097 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.176233 Nov 22 10:38:56.142488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 367/749] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:55 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:57.158684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:57.159316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:57.167517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:57.168130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:57.169320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:57.170234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:57.323509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:57.331778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-213e4acb-6956-4ec0-bfac-e37a1a95a01b tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.176933 Nov 22 10:38:57.332360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 383/750] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:57 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:58.349529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:58.350310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:58.357221 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:58.357670 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:58.358457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:58.358891 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:58.516983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:58.525306 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-705f9a84-9583-4550-9867-feeff95a9ee4 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.179948 Nov 22 10:38:58.525876 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 368/751] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:58 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:38:59.545566 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:38:59.546135 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:38:59.554191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:59.554691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:59.555541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:38:59.556087 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:38:59.704035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:38:59.712768 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-49b6b2b4-e672-41e9-ba6a-ca045b60098e tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1515 microversion: 2.1 time: 0.171382 Nov 22 10:38:59.713340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 384/752] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:38:59 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:00.541674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-f852efee-f9f8-4ba1-8041-5740b4d3cfa0 req-a5c88b6e-405c-4c80-ae6e-f07955de8ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7b7eca-3a44-4f4a-8674-03ae1147162c", "name": "network-vif-deleted", "tag": "d31f72a4-3cfb-4149-a149-0083a7db96b0"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:00.544227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:00.544227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:39:00.555211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f852efee-f9f8-4ba1-8041-5740b4d3cfa0 req-a5c88b6e-405c-4c80-ae6e-f07955de8ec5 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:00.555778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f852efee-f9f8-4ba1-8041-5740b4d3cfa0 req-a5c88b6e-405c-4c80-ae6e-f07955de8ec5 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:00.568060 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-f852efee-f9f8-4ba1-8041-5740b4d3cfa0 req-a5c88b6e-405c-4c80-ae6e-f07955de8ec5 service nova] Creating event network-vif-deleted:d31f72a4-3cfb-4149-a149-0083a7db96b0 for instance 2c7b7eca-3a44-4f4a-8674-03ae1147162c on hv-cinder-80403 Nov 22 10:39:00.574178 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-f852efee-f9f8-4ba1-8041-5740b4d3cfa0 req-a5c88b6e-405c-4c80-ae6e-f07955de8ec5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037576 Nov 22 10:39:00.574899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 369/753] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:00.732063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:00.732967 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:00.740942 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:00.741533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:00.742498 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:00.743139 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:00.779972 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:00.780433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:00.780892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'fault' on Instance uuid 2c7b7eca-3a44-4f4a-8674-03ae1147162c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:00.834011 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:00.842084 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c9e3a8e8-0333-4df3-95a7-ca96fed5d3a9 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1308 microversion: 2.1 time: 0.115121 Nov 22 10:39:00.842682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 385/754] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:00 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1308 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:01.861970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:01.862723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:01.870436 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:01.870856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:01.871759 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:01.872308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:01.909810 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:01.910249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:01.910748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'fault' on Instance uuid 2c7b7eca-3a44-4f4a-8674-03ae1147162c {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:01.959538 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:01.968186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-62ab629d-676b-4520-8e2b-97d2722358a7 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1308 microversion: 2.1 time: 0.110848 Nov 22 10:39:01.968809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 370/755] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:01 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:02.987107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:02.987740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:02.995196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:02.995686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:02.996589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:02.997059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:03.035440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:03.036078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:03.036737 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'fault' on Instance uuid 2c7b7eca-3a44-4f4a-8674-03ae1147162c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:03.086009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:03.094737 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-55d6de10-69b3-4e73-9bac-423285c7b63f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 200 len: 1308 microversion: 2.1 time: 0.111528 Nov 22 10:39:03.095435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 386/756] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:02 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:04.115022 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:04.115657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 2c7b7eca-3a44-4f4a-8674-03ae1147162c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:04.123127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:04.123543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:04.124451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:04.124882 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:04.139282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Instance 2c7b7eca-3a44-4f4a-8674-03ae1147162c could not be found. Nov 22 10:39:04.139950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 404 to user: Instance 2c7b7eca-3a44-4f4a-8674-03ae1147162c could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:39:04.140797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cc7c83a8-d414-4d91-b3b0-beeaf809dada tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c" status: 404 len: 111 microversion: 2.1 time: 0.029687 Nov 22 10:39:04.141656 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 371/757] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:04 2021] GET /compute/v2.1/servers/2c7b7eca-3a44-4f4a-8674-03ae1147162c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:39:05.291415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:05.293214 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:05.299775 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:05.300216 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:05.301017 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:05.301444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:05.341244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:39:05.431122 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ef341f6f-419a-4a89-9048-b9f119ee7697 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "DELETE /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 204 len: 0 microversion: 2.1 time: 0.143068 Nov 22 10:39:05.434790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 387/758] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:39:05 2021] DELETE /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:39:05.439719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:05.445998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:05.452820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:05.453277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:05.454059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:05.454493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:05.623332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:05.630984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f6b15a5a-d02d-4a33-ac5b-31636399cc02 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1515 microversion: 2.1 time: 0.195026 Nov 22 10:39:05.631552 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 372/759] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:05 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1515 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:06.649845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:06.650538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:06.657382 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:06.657827 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:06.658602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:06.659031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:06.802536 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:06.815071 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9b846c72-d1ea-4680-b971-a2e7764383ee tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1515 microversion: 2.1 time: 0.169259 Nov 22 10:39:06.816416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 388/760] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:06 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:39:07.836111 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:07.837627 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:07.844829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:07.845881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:07.847317 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:07.848057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:07.939518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:07.940200 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:07.946569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:07.947148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:07.948123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:07.948882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:08.052423 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lazy-loading 'services' on Instance uuid d6811294-cd5f-4f0a-8884-4ee50b5b4e20 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:08.136380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:08.144671 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a1a5c704-d988-4ea1-859f-3a32120e85bc tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1515 microversion: 2.1 time: 0.313327 Nov 22 10:39:08.145068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2a20112b-6d0d-4514-8fae-fb656bec9ee3 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20/os-volume_attachments/d8405d05-05d3-4a9b-b721-254286d36d8c" status: 202 len: 0 microversion: 2.1 time: 0.209185 Nov 22 10:39:08.145960 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 389/761] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:39:07 2021] DELETE /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20/os-volume_attachments/d8405d05-05d3-4a9b-b721-254286d36d8c => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:39:08.149199 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 373/762] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:07 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:08.475365 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-b35e6667-5081-4adc-ad15-d9ae383368b0 req-2e9b77e4-e5bc-40e1-9887-6c3711b4b630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27f777b2-7bd2-46fa-bd38-e601e5a904a7", "name": "network-vif-deleted", "tag": "7b29c6e7-c1ba-4983-ab04-3db1251a4a72"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:08.477014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:08.477014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:39:08.485375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b35e6667-5081-4adc-ad15-d9ae383368b0 req-2e9b77e4-e5bc-40e1-9887-6c3711b4b630 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:08.485375 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-b35e6667-5081-4adc-ad15-d9ae383368b0 req-2e9b77e4-e5bc-40e1-9887-6c3711b4b630 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:08.497550 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-b35e6667-5081-4adc-ad15-d9ae383368b0 req-2e9b77e4-e5bc-40e1-9887-6c3711b4b630 service nova] Creating event network-vif-deleted:7b29c6e7-c1ba-4983-ab04-3db1251a4a72 for instance 27f777b2-7bd2-46fa-bd38-e601e5a904a7 on hv-cinder-80403 Nov 22 10:39:08.503166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-b35e6667-5081-4adc-ad15-d9ae383368b0 req-2e9b77e4-e5bc-40e1-9887-6c3711b4b630 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032314 Nov 22 10:39:08.504309 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 390/763] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:09.165231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:09.165836 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:09.172785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.173240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.174070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.174549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.207493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.207871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.208328 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lazy-loading 'fault' on Instance uuid 27f777b2-7bd2-46fa-bd38-e601e5a904a7 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:09.252922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68748d566954625ac4a353c2a08b253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d11e30d2104dbf9ece93bc38472a72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:09.260160 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5606ca69-3af3-44f8-8a6b-d8095beec54f tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 200 len: 1308 microversion: 2.1 time: 0.098741 Nov 22 10:39:09.260839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 374/764] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:09 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:09.285943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:09.286516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:09.293509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.293961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.294752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.295190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.320891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:39:09.412687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bc185492-9b11-48b9-aaa0-c7bf194c4880 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 204 len: 0 microversion: 2.1 time: 0.131217 Nov 22 10:39:09.413333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 391/765] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:39:09 2021] DELETE /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:39:09.421352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:09.421954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:09.427899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.428422 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.429188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:09.429611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:09.586694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:09.595158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7e3f4c87-3c34-47cf-aea7-85b9cc6ac62f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1514 microversion: 2.1 time: 0.177447 Nov 22 10:39:09.595844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 375/766] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:09 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:10.278224 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:10.278912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] [instance: 27f777b2-7bd2-46fa-bd38-e601e5a904a7] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:10.285797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:10.286244 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:10.287322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:10.287408 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:10.305174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] HTTP exception thrown: Instance 27f777b2-7bd2-46fa-bd38-e601e5a904a7 could not be found. Nov 22 10:39:10.306218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] Returning 404 to user: Instance 27f777b2-7bd2-46fa-bd38-e601e5a904a7 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:39:10.307869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-887e7c0c-aac9-4806-87af-c510b3abf7c3 tempest-AttachVolumeNegativeTest-1283574447 tempest-AttachVolumeNegativeTest-1283574447-project] 10.222.0.46 "GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7" status: 404 len: 111 microversion: 2.1 time: 0.033718 Nov 22 10:39:10.308840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 392/767] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:10 2021] GET /compute/v2.1/servers/27f777b2-7bd2-46fa-bd38-e601e5a904a7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:39:10.613276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:10.613886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:10.620305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:10.620786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:10.621562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:10.622242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:10.870667 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:10.885264 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a074360b-db1c-46c1-83a5-9b2e63625e76 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1514 microversion: 2.1 time: 0.275306 Nov 22 10:39:10.888445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 376/768] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:10 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1514 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:11.912292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:11.912997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:11.920285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:11.920820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:11.921717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:11.922185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:12.066902 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:12.075083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-49bdc66b-7631-4d34-a65a-f851121fd3f5 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1514 microversion: 2.1 time: 0.166631 Nov 22 10:39:12.075704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 393/769] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:11 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:13.092927 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:13.093992 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:13.101818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:13.102530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:13.103143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:13.103676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:13.242875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:13.250780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-343f6fd5-59fd-4700-9716-03ef8352cc92 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1514 microversion: 2.1 time: 0.162185 Nov 22 10:39:13.251371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 377/770] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:13 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:13.906335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-c3aa5b68-bad1-45c6-8d7f-ec34af0caea9 req-2c195e98-5906-4283-90cb-cd15e8c3454d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6811294-cd5f-4f0a-8884-4ee50b5b4e20", "name": "network-vif-deleted", "tag": "e10e9677-3206-459d-8974-fe40b23be904"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:13.907828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:13.907828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:39:13.918448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c3aa5b68-bad1-45c6-8d7f-ec34af0caea9 req-2c195e98-5906-4283-90cb-cd15e8c3454d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:13.918448 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c3aa5b68-bad1-45c6-8d7f-ec34af0caea9 req-2c195e98-5906-4283-90cb-cd15e8c3454d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:13.933943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-c3aa5b68-bad1-45c6-8d7f-ec34af0caea9 req-2c195e98-5906-4283-90cb-cd15e8c3454d service nova] Creating event network-vif-deleted:e10e9677-3206-459d-8974-fe40b23be904 for instance d6811294-cd5f-4f0a-8884-4ee50b5b4e20 on hv-cinder-80403 Nov 22 10:39:13.941215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-c3aa5b68-bad1-45c6-8d7f-ec34af0caea9 req-2c195e98-5906-4283-90cb-cd15e8c3454d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039866 Nov 22 10:39:13.942015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 394/771] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:14.268467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:14.269327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:14.279775 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:14.280554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:14.281909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:14.282509 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:14.315632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:14.316095 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:14.316535 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lazy-loading 'fault' on Instance uuid d6811294-cd5f-4f0a-8884-4ee50b5b4e20 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:14.361201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:14.369549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6863c454-c3c9-4376-9866-d5138798b984 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 200 len: 1308 microversion: 2.1 time: 0.105491 Nov 22 10:39:14.370302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 378/772] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:14 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:15.388534 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:15.389218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: d6811294-cd5f-4f0a-8884-4ee50b5b4e20] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:15.396178 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:15.396617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:15.397395 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:15.397826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:15.411320 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] HTTP exception thrown: Instance d6811294-cd5f-4f0a-8884-4ee50b5b4e20 could not be found. Nov 22 10:39:15.411941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Returning 404 to user: Instance d6811294-cd5f-4f0a-8884-4ee50b5b4e20 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:39:15.412751 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db74d625-5fd6-45e9-8662-49ec7691bd5f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20" status: 404 len: 111 microversion: 2.1 time: 0.028456 Nov 22 10:39:15.413298 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 395/773] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:15 2021] GET /compute/v2.1/servers/d6811294-cd5f-4f0a-8884-4ee50b5b4e20 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:39:28.451301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1054869936", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "networks": [{"uuid": "8322e46a-3342-4b13-a227-93a753c68c4d"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:28.513374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] validate_networks() for [('8322e46a-3342-4b13-a227-93a753c68c4d', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:39:29.125856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:39:29.126367 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:39:29.126939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:39:29.127345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:39:29.127792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:39:29.136872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:29.137318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:29.138141 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:29.138560 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:29.158086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Getting quotas for project 93b9423a62144c8a975aacb49a424865. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:39:29.162268 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Getting quotas for user 2613f7c84b1540829f4cdeb9c28b8f5b and project 93b9423a62144c8a975aacb49a424865. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:39:29.174114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:39:29.176506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:39:29.222914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6c41a480-9e4a-439b-9523-276641726dbe tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775983 Nov 22 10:39:29.228709 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 379/774] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:39:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:39:29.233887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b898975f-431d-412f-ac80-dd46a5330264 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:29.234510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b898975f-431d-412f-ac80-dd46a5330264 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:29.293598 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b898975f-431d-412f-ac80-dd46a5330264 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:29.301069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b898975f-431d-412f-ac80-dd46a5330264 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1219 microversion: 2.1 time: 0.070855 Nov 22 10:39:29.302221 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 396/775] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:29 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:30.319932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:30.320513 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:30.327011 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:30.327468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:30.328337 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:30.329001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:30.407697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:30.415480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8345fd4d-8bfa-435d-8206-e9880bafad27 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1223 microversion: 2.1 time: 0.100106 Nov 22 10:39:30.421563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 380/776] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:30 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:31.433264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:31.433867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:31.441607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:31.442062 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:31.442858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:31.443291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:31.504899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:31.512810 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9b36bb70-72d5-47c8-ae2f-02308a1e94d8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1223 microversion: 2.1 time: 0.083625 Nov 22 10:39:31.513403 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 397/777] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:31 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:32.529903 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:32.530503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:32.537453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:32.537902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:32.538802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:32.539245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:32.602574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:32.610479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-212cbace-acfb-4cc3-b95d-99eb196cad51 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1215 microversion: 2.1 time: 0.084463 Nov 22 10:39:32.611065 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 381/778] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:32 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:33.627291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:33.627998 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:33.636822 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:33.637300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:33.638105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:33.638538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:33.736806 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:33.745519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b44310aa-2c0c-4ee1-aedd-8baa126f1b94 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1277 microversion: 2.1 time: 0.121906 Nov 22 10:39:33.746324 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 398/779] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:33 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:34.764963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:34.765755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:34.773345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:34.773806 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:34.774852 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:34.775413 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:34.843009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-ccb50ddb-98b4-4c8d-8383-4ac3b623663b req-c24dd978-e5f3-4e63-ba1b-98804a7ebfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd645b8b-bb68-49af-b7dd-c5ddaa34211d", "tag": "a9364ed3-4993-414b-bbd3-aef1145ba8b5"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:34.847347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:34.847347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:39:34.868634 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ccb50ddb-98b4-4c8d-8383-4ac3b623663b req-c24dd978-e5f3-4e63-ba1b-98804a7ebfa7 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:34.869068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-ccb50ddb-98b4-4c8d-8383-4ac3b623663b req-c24dd978-e5f3-4e63-ba1b-98804a7ebfa7 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:34.898034 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-ccb50ddb-98b4-4c8d-8383-4ac3b623663b req-c24dd978-e5f3-4e63-ba1b-98804a7ebfa7 service nova] Creating event network-changed:a9364ed3-4993-414b-bbd3-aef1145ba8b5 for instance cd645b8b-bb68-49af-b7dd-c5ddaa34211d on hv-cinder-80403 Nov 22 10:39:34.903827 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-ccb50ddb-98b4-4c8d-8383-4ac3b623663b req-c24dd978-e5f3-4e63-ba1b-98804a7ebfa7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070064 Nov 22 10:39:34.905067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 399/780] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:34.976386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:34.987682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b0c7a00c-62d3-49ac-8bb1-003051dd5088 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.226650 Nov 22 10:39:34.988312 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 382/781] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:34 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:39:36.006481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:36.007190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:36.014052 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.014515 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.015323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.015787 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.209332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:36.218814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e8636d91-9c0d-4189-af69-252d70c6846f tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.217072 Nov 22 10:39:36.219449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 400/782] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:36 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:36.568200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:36.569234 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:36.576382 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.576831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.577615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.578045 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.659182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f10a6bd5-5833-4468-aad8-7b6dc4151b00 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action" status: 202 len: 0 microversion: 2.1 time: 0.094688 Nov 22 10:39:36.659896 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 383/783] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:39:36 2021] POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:39:36.669016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:36.669652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:36.676228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.676682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.677481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:36.677916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:36.836535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:36.846280 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7d28da1f-f5df-4f3f-b3db-885380295d85 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1750 microversion: 2.1 time: 0.181165 Nov 22 10:39:36.846912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 401/784] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:36 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1750 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:37.238312 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:37.239016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:37.245727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:37.246199 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:37.246954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:37.247381 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:37.381544 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:37.389374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3e90787d-275f-4248-9f07-63515f293e56 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.155486 Nov 22 10:39:37.389987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 384/785] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:37 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:37.866428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:37.868002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:37.877336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:37.878374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:37.879276 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:37.879989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:38.230409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:38.239119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6b16eea8-b351-4a8e-8a6d-76c6084070fb tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1750 microversion: 2.1 time: 0.377913 Nov 22 10:39:38.239720 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 402/786] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:37 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1750 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:38.406839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:38.407495 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:38.414244 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:38.414937 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:38.415842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:38.416459 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:38.802619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:38.810762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c3135cf9-eedd-4291-b25b-14e911a90cb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.407578 Nov 22 10:39:38.811451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 385/787] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:38 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:39.258355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:39.259019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:39.267057 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:39.267503 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:39.268332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:39.268759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:39.430729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:39.439511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-07c920cf-b1d8-4e13-a3e7-04de5839fd0a tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.185717 Nov 22 10:39:39.440124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 403/788] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:39 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:39.829219 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:39.829805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:39.837417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:39.839064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:39.839936 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:39.840373 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:39.980900 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:39.989378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e1712a37-ac1a-4761-9422-843e1101900a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.164962 Nov 22 10:39:39.989988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 386/789] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:39 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:40.457583 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:40.458230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:40.465877 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:40.466376 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:40.469014 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:40.469459 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:40.792553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:40.800962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-15ab95f6-6500-41a1-8fe5-c3883400d105 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.347172 Nov 22 10:39:40.801563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 404/790] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:40 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:41.006482 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:41.007025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:41.015020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:41.015712 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:41.016747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:41.017180 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:41.209129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:41.217082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f873ac49-e20c-4b8e-83de-96f731938dd8 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.214519 Nov 22 10:39:41.217669 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 387/791] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:41 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:41.819504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:41.820404 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:41.827200 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:41.827655 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:41.828473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:41.828912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:42.016313 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:42.024563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-00b75a7a-f208-43cf-8f53-3802fd303583 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.208699 Nov 22 10:39:42.025167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 405/792] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:41 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:42.235731 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:42.236540 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:42.243520 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:42.245821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:42.247035 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:42.247970 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:42.413758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:42.421449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-052c126c-d9f2-4524-be84-079e3470e17c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.190009 Nov 22 10:39:42.422033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 388/793] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:42 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:43.045325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:43.046628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:43.057562 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.058183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.059059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.059642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.273111 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:43.282138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0f427ff0-9649-4db1-a62f-5e7ebb388f60 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.243562 Nov 22 10:39:43.293483 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 406/794] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:43 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:43.438571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:43.439718 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:43.449610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.450345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.451296 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.451914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.635922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:43.643592 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-eb64a67e-b60a-4a37-ac74-125f24138029 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.208638 Nov 22 10:39:43.645207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 389/795] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:43 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:43.659307 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-d89bcb97-f152-424f-a88e-a6d45a7e580f req-d1e8fbf7-273b-49b7-be40-524d5140e128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd645b8b-bb68-49af-b7dd-c5ddaa34211d", "name": "network-vif-plugged", "status": "completed", "tag": "a9364ed3-4993-414b-bbd3-aef1145ba8b5"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:43.660926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:43.660926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:39:43.670169 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d89bcb97-f152-424f-a88e-a6d45a7e580f req-d1e8fbf7-273b-49b7-be40-524d5140e128 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.670648 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d89bcb97-f152-424f-a88e-a6d45a7e580f req-d1e8fbf7-273b-49b7-be40-524d5140e128 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.687949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-d89bcb97-f152-424f-a88e-a6d45a7e580f req-d1e8fbf7-273b-49b7-be40-524d5140e128 service nova] Creating event network-vif-plugged:a9364ed3-4993-414b-bbd3-aef1145ba8b5 for instance cd645b8b-bb68-49af-b7dd-c5ddaa34211d on hv-cinder-80403 Nov 22 10:39:43.693496 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-d89bcb97-f152-424f-a88e-a6d45a7e580f req-d1e8fbf7-273b-49b7-be40-524d5140e128 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038055 Nov 22 10:39:43.694766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 407/796] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:43.884225 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:43.884817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:43.893987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.894608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.895341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:43.895945 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:43.933207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-645f9d99-d97a-498d-8124-08d269da3991 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments/12495a69-ec0f-495e-8bd3-60fee25b8f82" status: 200 len: 194 microversion: 2.20 time: 0.053376 Nov 22 10:39:43.939292 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 390/797] 10.222.0.46 () {60 vars in 1453 bytes} [Mon Nov 22 10:39:43 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments/12495a69-ec0f-495e-8bd3-60fee25b8f82 => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:39:44.008446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:44.009054 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:44.016764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.017510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.019157 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.020288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.112110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lazy-loading 'services' on Instance uuid 640f234a-3202-4c2c-97b9-32b4048c9ef3 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:39:44.198676 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a39c53da-d6bc-42e1-8d88-16b86b59f39f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments/12495a69-ec0f-495e-8bd3-60fee25b8f82" status: 202 len: 0 microversion: 2.20 time: 0.195367 Nov 22 10:39:44.199932 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 408/798] 10.222.0.46 () {60 vars in 1456 bytes} [Mon Nov 22 10:39:44 2021] DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments/12495a69-ec0f-495e-8bd3-60fee25b8f82 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:39:44.208705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:44.209872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:44.217906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.218443 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.219568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.220255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.266499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2a64825c-203c-4c1f-be94-3fe02813d016 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061934 Nov 22 10:39:44.267087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 391/799] 10.222.0.46 () {60 vars in 1342 bytes} [Mon Nov 22 10:39:44 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:39:44.302808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:44.303856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:44.318141 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.318628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.319453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.319897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.504891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:44.514964 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ea5560af-8137-4051-a980-47de89d8e284 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.217095 Nov 22 10:39:44.515566 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 409/800] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:44 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:44.662356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:44.662991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:44.670114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.670587 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.671358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:44.671815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:44.819265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:44.827890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f6ee5185-6540-400b-836b-fefc4fd9be84 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1319 microversion: 2.1 time: 0.169296 Nov 22 10:39:44.828524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 392/801] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:44 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:45.278130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:45.279159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:45.286556 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.287449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.288641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.289235 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.323821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7ed563f9-e43d-4467-a54e-7622727a7477 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049142 Nov 22 10:39:45.324117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 410/802] 10.222.0.46 () {60 vars in 1342 bytes} [Mon Nov 22 10:39:45 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:39:45.399284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:45.399284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:45.404439 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.405780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.406748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.407308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.437683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:39:45.529415 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b696b61b-0390-4baa-b316-412a40b02d45 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 204 len: 0 microversion: 2.20 time: 0.138020 Nov 22 10:39:45.530309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 393/803] 10.222.0.46 () {60 vars in 1279 bytes} [Mon Nov 22 10:39:45 2021] DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:39:45.537450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:45.538909 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:45.539470 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:45.540259 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:45.546634 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.547012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.547467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.547890 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.548359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.548789 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.549715 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.550350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.763298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:45.771794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:45.773341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:45.774516 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e437e00e-a552-4104-b8da-7ac2dcd3a62e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.239213 Nov 22 10:39:45.775326 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 394/804] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:45 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:39:45.807416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:45.815898 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-68f3af2c-f1e9-4f6a-bf7f-cd5ef812d35d tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.282545 Nov 22 10:39:45.816563 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 411/805] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:45 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:45.846688 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:45.847568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:45.855050 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.855615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:45.856622 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:45.857123 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.004085 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:46.013041 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-70af49d9-667d-4c58-9255-e98766c82044 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1508 microversion: 2.1 time: 0.170854 Nov 22 10:39:46.013638 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 395/806] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:45 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:46.034977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b1e8330b-69be-47fb-a75a-db0620f839a8", "device": "/dev/sdb"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:46.036654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:46.042988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.043429 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.044229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.044675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.328284 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1e204859-aff8-47f9-8a22-6c6e789ddbb9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "POST /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297177 Nov 22 10:39:46.329046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 412/807] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:39:46 2021] POST /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:39:46.792776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:46.793462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:46.799772 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.800219 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.800983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.801409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.834545 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:46.835243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:46.844895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.845471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:46.846412 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:46.847146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:47.223947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:47.234387 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:47.238527 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:47.240017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1e3d5eea-bdfa-4198-a700-888146307bd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.451228 Nov 22 10:39:47.241081 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 396/808] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:46 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:47.330499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:47.340122 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a3a6f7c8-db3c-4a71-bb53-3b308dd00fef tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.509801 Nov 22 10:39:47.340719 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 413/809] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:46 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:48.260359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:48.261091 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:48.268486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:48.268934 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:48.269746 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:48.270201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:48.362499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:48.363912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:48.372630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:48.373438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:48.374492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:48.375090 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:48.573967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:48.583394 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:48.585019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:48.586332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8bea20ee-c2e7-4405-8eb1-77f97a5b8853 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 200 len: 1721 microversion: 2.20 time: 0.330490 Nov 22 10:39:48.587009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 397/810] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:48 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:48.703229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:48.713903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6339acc8-0b74-482d-bb5f-44977670d866 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.356481 Nov 22 10:39:48.714333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 414/811] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:48 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:48.890324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-2ed595a0-1064-477d-a90e-8b64b17cda85 req-ab1926c8-550b-4acd-aa48-b3f3cf18380a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f234a-3202-4c2c-97b9-32b4048c9ef3", "name": "network-vif-deleted", "tag": "1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:48.891977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:48.891977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:39:48.903121 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-2ed595a0-1064-477d-a90e-8b64b17cda85 req-ab1926c8-550b-4acd-aa48-b3f3cf18380a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:48.903923 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-2ed595a0-1064-477d-a90e-8b64b17cda85 req-ab1926c8-550b-4acd-aa48-b3f3cf18380a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:48.919249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-2ed595a0-1064-477d-a90e-8b64b17cda85 req-ab1926c8-550b-4acd-aa48-b3f3cf18380a service nova] Creating event network-vif-deleted:1bc4a856-a7af-4fd0-9a06-e7cf11dae4ec for instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 on hv-cinder-80403 Nov 22 10:39:48.924703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-2ed595a0-1064-477d-a90e-8b64b17cda85 req-ab1926c8-550b-4acd-aa48-b3f3cf18380a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039543 Nov 22 10:39:48.925341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 398/812] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:39:49.734529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:49.736062 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:49.745888 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:49.746612 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:49.748314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:49.748949 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:49.994253 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:49.994870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:50.002582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:50.003567 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:50.004766 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:50.007602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:50.039630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. Nov 22 10:39:50.042339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:39:50.043340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3a4239f0-cd4b-46e7-908d-ac536b22df94 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 404 len: 111 microversion: 2.20 time: 0.440745 Nov 22 10:39:50.050859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 415/813] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:49 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 111 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:39:50.056863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-196859b2-c375-4805-a4de-89d027c6f5e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '.version_select at 0x7f1a593ddca0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:50.060979 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: ERROR oslo.messaging._drivers.impl_rabbit [None req-196859b2-c375-4805-a4de-89d027c6f5e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [bcb13403-0726-4ab5-878d-1151f94289fb] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 10:39:50.102912 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:50.113917 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3b6070b7-1a1a-446a-8bde-0372d68ada3e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.383919 Nov 22 10:39:50.115158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 399/814] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:49 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:51.069318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:39:51.069899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:39:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:39:51.080322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [None req-196859b2-c375-4805-a4de-89d027c6f5e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [bcb13403-0726-4ab5-878d-1151f94289fb] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 32800. Nov 22 10:39:51.106026 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-196859b2-c375-4805-a4de-89d027c6f5e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132484250" status: 204 len: 0 microversion: 2.20 time: 1.053457 Nov 22 10:39:51.106654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 416/815] 10.222.0.46 () {60 vars in 1261 bytes} [Mon Nov 22 10:39:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132484250 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:39:51.133432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:51.134110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:51.141754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:51.142434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:51.143654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:51.144115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:51.359561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:51.378341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5a05e655-9d90-40b3-a38b-d1d4a9548696 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.248672 Nov 22 10:39:51.379254 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 400/816] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:51 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:39:51.877928 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: .version_select at 0x7f1a59353d30>, body: {"keypair": {"name": "tempest-keypair-1883177468"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:51.896411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:39:51.900569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:39:52.058824 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:52.060796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:52.067796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.068132 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.068984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.069480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.096586 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:39:52.104146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:39:52.106002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9e4eb096-114e-42d5-9ce9-c413272bd716 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051932 Nov 22 10:39:52.106611 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 401/817] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:39:52 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:39:52.122887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9d08cbae-aa89-41fc-93d9-7a364890d601 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.247790 Nov 22 10:39:52.122887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 417/818] 10.222.0.46 () {62 vars in 1198 bytes} [Mon Nov 22 10:39:51 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:39:52.172077 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:52.172077 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:52.178527 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.178918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.180108 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.180526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.210523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:39:52.313525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3d8a0721-41e0-487e-a817-1edd8a60d879 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 204 len: 0 microversion: 2.1 time: 0.147361 Nov 22 10:39:52.315561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 402/819] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:39:52 2021] DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:39:52.328059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:52.328885 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:52.335551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.336380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.337090 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.337585 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.401983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:52.402968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:52.410477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.410994 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.411796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:52.412228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:52.569129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:52.579528 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-794ffd4a-adda-496f-8125-d0ff1a8afcf4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1671 microversion: 2.1 time: 0.259547 Nov 22 10:39:52.580199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 418/820] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:52 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:52.631315 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:52.640449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bd063ebe-7e36-4cc3-9383-81f28580c340 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.243884 Nov 22 10:39:52.641214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 403/821] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:52 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:53.498112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1148006058", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e114790e-2c2f-46a4-8dd6-49197de38f16"}], "security_groups": [{"name": "tempest-securitygroup--631611765"}], "key_name": "tempest-keypair-1883177468", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:53.598783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:53.600083 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:53.607447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:53.607940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:53.608717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:53.609341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:53.613397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] validate_networks() for [('e114790e-2c2f-46a4-8dd6-49197de38f16', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:39:53.857750 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:53.868127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-11ac9eab-bb79-41e8-a62f-cf1ccb0124d4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1671 microversion: 2.1 time: 0.273405 Nov 22 10:39:53.869892 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 404/822] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:53 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:39:53.875146 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:53.875774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:53.882282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:53.882725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:53.883800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:53.884381 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:54.164625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:54.176607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cb3166d1-9d13-4ff6-85d9-079ed48e6040 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.304987 Nov 22 10:39:54.187687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:39:54.187687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:39:54.187687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:39:54.187687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:39:54.187687 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:39:54.188434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 405/823] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:53 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:54.202999 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:54.204249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:54.204494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:54.204950 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:54.224271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:39:54.228533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Getting quotas for user f6b3fe28f16a45ff8b476fd2de4d557b and project f2a799df19ef409eb8975d5f05fa1c01. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:39:54.240782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:39:54.243103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:39:54.293304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1672677f-32b0-41ae-bd98-990167099642 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.799356 Nov 22 10:39:54.294128 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 419/824] 10.222.0.46 () {62 vars in 1187 bytes} [Mon Nov 22 10:39:53 2021] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 10:39:54.304014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:54.304996 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:54.362632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:54.370583 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:54.372150 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:54.373263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b9c19916-0790-4225-a3c2-9a5b5f9982e4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1282 microversion: 2.20 time: 0.073189 Nov 22 10:39:54.384334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 406/825] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:54 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:54.888159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:54.888841 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:54.899916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:54.900464 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:54.901653 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:54.902201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:55.068597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:55.077477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e5dfb359-affd-486d-83cd-05bd32bafd04 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1671 microversion: 2.1 time: 0.194475 Nov 22 10:39:55.078170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 420/826] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:54 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1671 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:55.194473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:55.195279 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:55.201736 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:55.202293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:55.203307 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:55.203955 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:55.360016 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:55.368299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-836f919d-c2dd-4e68-87eb-4eaf2ef611f5 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.177510 Nov 22 10:39:55.369001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 407/827] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:55 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:55.392225 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:55.392838 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:55.399177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:55.399643 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:55.400589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:55.401232 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:55.476401 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:55.491721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:55.493296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:55.494486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-218102a5-3083-4f1a-bd37-b09982e98169 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1286 microversion: 2.20 time: 0.106077 Nov 22 10:39:55.495510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 421/828] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:55 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:56.094988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:56.095800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:56.103462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.103882 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.104659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.105099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.248492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:56.256054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6d154ad5-c9be-4186-9f7a-f31b2f84f0b4 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1671 microversion: 2.1 time: 0.165358 Nov 22 10:39:56.256621 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 408/829] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:56 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:56.386921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:56.387468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:56.394081 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.394511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.395295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.395772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.513179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:56.513787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:56.519784 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.520234 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.521026 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:56.521457 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:56.556187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:56.564920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c852384a-56f6-46d3-add4-a0aa9dd367cc tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.182196 Nov 22 10:39:56.566174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 422/830] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:56 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:56.592599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:56.600873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:56.602342 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:56.603499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c9510b31-b49f-44f7-b5bf-a2072689b76f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1286 microversion: 2.20 time: 0.094409 Nov 22 10:39:56.604459 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 409/831] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:56 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:39:57.273891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:57.274910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:57.281249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.281702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.282497 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.282935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.544697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:57.566223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fe2aefe4-2263-44be-b27e-2221a38cab31 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1671 microversion: 2.1 time: 0.284145 Nov 22 10:39:57.567308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 423/832] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:57 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1671 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:57.587474 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:57.590265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:57.611216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.611833 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.617114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.617780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.622327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:57.623299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:57.633656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.639188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.640657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:57.641308 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:57.749413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:57.759778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:57.761849 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:57.763373 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c89a0619-b36c-478a-ad3d-4e1d47c80a1e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1334 microversion: 2.20 time: 0.145104 Nov 22 10:39:57.764449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 424/833] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:57 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1334 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:58.093899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:58.103697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-51b7d9c3-9111-4c00-bcda-976369d9de27 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1755 microversion: 2.1 time: 0.524361 Nov 22 10:39:58.104531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 410/834] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:57 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1755 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:58.591202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:58.592043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:58.600069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:58.600612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:58.601500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:58.602040 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:58.719516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:58.737456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1802aa4a-b247-4722-b017-7aafe3804a93 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1604 microversion: 2.1 time: 0.150612 Nov 22 10:39:58.738046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 425/835] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:58 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:58.783397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:58.787564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:58.794741 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:58.795498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:58.796412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:58.797164 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:58.874565 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:58.883584 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:58.885454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:58.886672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-abe70b68-8e18-4097-9114-761ac1eb33ae tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1340 microversion: 2.20 time: 0.107866 Nov 22 10:39:58.887429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 411/836] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:58 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1340 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:39:59.122997 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:59.123894 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:59.130456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.131196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.132257 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.132912 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.138945 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-3fd28ad8-d333-4502-9a72-6c713f3e6a03 req-551ded87-39d5-476e-91e4-6d36e927ac0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516b0499-a733-410c-9a0c-6e98ff43aba0", "name": "network-vif-deleted", "tag": "16c7e493-84ec-4f05-8c01-8c85e582654e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:39:59.140848 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:39:59.140848 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:39:59.152316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3fd28ad8-d333-4502-9a72-6c713f3e6a03 req-551ded87-39d5-476e-91e4-6d36e927ac0d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.152766 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3fd28ad8-d333-4502-9a72-6c713f3e6a03 req-551ded87-39d5-476e-91e4-6d36e927ac0d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.172313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-3fd28ad8-d333-4502-9a72-6c713f3e6a03 req-551ded87-39d5-476e-91e4-6d36e927ac0d service nova] Creating event network-vif-deleted:16c7e493-84ec-4f05-8c01-8c85e582654e for instance 516b0499-a733-410c-9a0c-6e98ff43aba0 on hv-cinder-80403 Nov 22 10:39:59.178269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-3fd28ad8-d333-4502-9a72-6c713f3e6a03 req-551ded87-39d5-476e-91e4-6d36e927ac0d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042982 Nov 22 10:39:59.179479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 412/837] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:39:59.374541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:59.383370 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bb1a2f68-516f-4b43-a547-7ab2efd945ec tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1758 microversion: 2.1 time: 0.264502 Nov 22 10:39:59.384243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 426/838] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:59 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1758 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:59.755197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:59.756049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:59.764002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.764452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.765247 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.765682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.840168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:39:59.849888 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-37be647a-4f22-4796-a1a9-5af33793ac3a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1321 microversion: 2.1 time: 0.098679 Nov 22 10:39:59.859587 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 413/839] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:39:59 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1321 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:39:59.915330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:39:59.916228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:39:59.923169 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.923627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:39:59.924466 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:39:59.924905 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:00.083398 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:00.092658 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:00.094475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:00.095650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ca10753a-fb7e-4b12-b3ad-9f39438df74d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.184491 Nov 22 10:40:00.096389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 427/840] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:39:59 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:00.872294 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:00.872953 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:00.880863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:00.881396 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:00.882331 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:00.882863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:00.949681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:00.957932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-093253d0-82a9-4daa-b8b2-77e4f75157ff tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 200 len: 1321 microversion: 2.1 time: 0.089952 Nov 22 10:40:00.958681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 414/841] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:00 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 1321 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:01.116398 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:01.116992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:01.124874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:01.125386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:01.126331 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:01.126921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:01.284599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:01.296332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:01.297836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:01.298949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-206b975e-301c-4c0e-8e60-52e9dab7c2c6 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.187701 Nov 22 10:40:01.299534 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 428/842] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:01 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:01.978201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:01.979040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:01.986353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:01.986927 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:01.987807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:01.988303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:02.003924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. Nov 22 10:40:02.004672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:40:02.005590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cf1ccadf-bbdb-4c59-941d-ec10259ed952 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 404 len: 111 microversion: 2.1 time: 0.033636 Nov 22 10:40:02.006526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 415/843] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:01 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:40:02.016004 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-dcefc332-5d1d-4546-a2ce-c7c35af333b0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '.version_select at 0x7f1a59307550>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:02.039657 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-dcefc332-5d1d-4546-a2ce-c7c35af333b0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668343336" status: 202 len: 0 microversion: 2.1 time: 0.028042 Nov 22 10:40:02.040802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 429/844] 10.222.0.46 () {58 vars in 1217 bytes} [Mon Nov 22 10:40:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668343336 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:02.233100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-0aaacf88-0139-4619-b82b-bc41aedd0a7e req-b0245695-2f1a-4796-aa27-23d2744d7bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:02.244070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:02.244070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:02.267571 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-0aaacf88-0139-4619-b82b-bc41aedd0a7e req-b0245695-2f1a-4796-aa27-23d2744d7bf2 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:02.268012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-0aaacf88-0139-4619-b82b-bc41aedd0a7e req-b0245695-2f1a-4796-aa27-23d2744d7bf2 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:02.289407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-0aaacf88-0139-4619-b82b-bc41aedd0a7e req-b0245695-2f1a-4796-aa27-23d2744d7bf2 service nova] Creating event network-changed:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:40:02.297957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-0aaacf88-0139-4619-b82b-bc41aedd0a7e req-b0245695-2f1a-4796-aa27-23d2744d7bf2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069631 Nov 22 10:40:02.299398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 416/845] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:02.318208 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:02.320009 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:02.328674 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:02.329161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:02.330049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:02.330538 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:02.697756 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:02.712870 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:02.716371 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:02.718293 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-eebd2cea-b1f6-4844-8db6-5041887d1ddc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.404227 Nov 22 10:40:02.719527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 430/846] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:02 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:40:02.938545 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: .version_select at 0x7f1a592ae700>, body: {"keypair": {"name": "tempest-keypair-278541652"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:02.953719 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:40:02.958328 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:40:03.485918 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:40:03.490080 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'key_pairs'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:40:03.505473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-27b57c93-6046-4aae-ae06-388ccff01cea tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.571132 Nov 22 10:40:03.506978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 417/847] 10.222.0.46 () {60 vars in 1157 bytes} [Mon Nov 22 10:40:02 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:03.740386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:03.741160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:03.756149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:03.757919 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:03.759471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:03.760521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:04.033148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:04.051598 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:04.053317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:04.054608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0fdbf741-476c-4b19-bf44-a09c911eb578 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.319400 Nov 22 10:40:04.055310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 431/848] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:03 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:05.080412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:05.081707 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:05.092562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:05.093006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:05.094455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:05.095144 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:05.281662 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:05.290794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:05.292406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:05.293951 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0849bb0a-c329-452f-a99c-b01d6aa343c7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.217193 Nov 22 10:40:05.294523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 418/849] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:05 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:05.500425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1796412026", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8081780-6619-4e5e-aa59-236a3848a084"}], "security_groups": [{"name": "tempest-securitygroup--339450548"}], "key_name": "tempest-keypair-278541652", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:05.617741 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] validate_networks() for [('f8081780-6619-4e5e-aa59-236a3848a084', None, None, None, None, None)] {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:40:05.845371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:05.845999 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:05.852857 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:05.853393 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:05.854190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:05.854624 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:05.955478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lazy-loading 'services' on Instance uuid cd645b8b-bb68-49af-b7dd-c5ddaa34211d {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:06.031194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-65173fbf-ed51-474e-a69d-d3d7d06fe403 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d/os-volume_attachments/b1e8330b-69be-47fb-a75a-db0620f839a8" status: 202 len: 0 microversion: 2.1 time: 0.189174 Nov 22 10:40:06.031829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 419/850] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:40:05 2021] DELETE /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d/os-volume_attachments/b1e8330b-69be-47fb-a75a-db0620f839a8 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:06.262236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:40:06.262742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:40:06.263411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:40:06.263888 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:40:06.264266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:40:06.281814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:06.282318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:06.283068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:06.283500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:06.300879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:40:06.305740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Getting quotas for user 1c802b5b33724e6aa81889a01725ef02 and project ea3b1b45ca144f90b1c89acf24e22074. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:40:06.313322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:06.314027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:06.321428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:06.321793 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:06.322774 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:06.323380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:06.325017 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:40:06.327278 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:40:06.388026 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d352933f-e368-4046-a505-58e378918234 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.891762 Nov 22 10:40:06.388541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 432/851] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:40:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:40:06.401656 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0cd2d975-ec50-4f0b-85d7-12d408e5bcc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:06.402697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0cd2d975-ec50-4f0b-85d7-12d408e5bcc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:06.518510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0cd2d975-ec50-4f0b-85d7-12d408e5bcc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:06.539258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0cd2d975-ec50-4f0b-85d7-12d408e5bcc8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1237 microversion: 2.1 time: 0.134068 Nov 22 10:40:06.540065 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 433/852] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:06 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1237 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:06.578769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:06.596924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:06.598462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:06.608385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-bab70542-6f99-4edd-863c-4df765a559cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.295789 Nov 22 10:40:06.610109 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 420/853] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:06 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:40:07.171799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:07.172778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:07.179299 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.180170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.181242 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.182072 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.211636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:40:07.304767 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-76a745d3-90fa-4fec-8464-5a28c7c49a2a tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 204 len: 0 microversion: 2.1 time: 0.138899 Nov 22 10:40:07.305287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 434/854] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:40:07 2021] DELETE /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:40:07.315213 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:07.316433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:07.323088 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.323845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.324725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.325168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.478228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:07.486575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-15430ba0-c16a-4737-a24b-4809e60b4165 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1514 microversion: 2.1 time: 0.176081 Nov 22 10:40:07.487163 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 421/855] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:07 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:07.557817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:07.559328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:07.571989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.571989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.571989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.571989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.627554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:07.628814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:07.638280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.638733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.639543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:07.640028 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:07.669118 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:07.677925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e273c100-f2d3-4f79-a735-c8c72ae3740c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1289 microversion: 2.1 time: 0.124317 Nov 22 10:40:07.678542 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 435/856] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:07 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:07.906015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:07.915275 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:07.916840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:07.918175 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e9d16947-533c-418a-bcd6-142107067d10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.294396 Nov 22 10:40:07.919899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 422/857] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:07 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:40:08.504703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:08.505861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:08.513264 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:08.514281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:08.515624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:08.516535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:08.581716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-df307c5f-8990-492c-a037-cd457888114c req-67c7c6d1-4479-4932-a00a-c58b7ca35a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "name": "network-vif-plugged", "status": "completed", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:08.583636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:08.583636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:08.592043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-df307c5f-8990-492c-a037-cd457888114c req-67c7c6d1-4479-4932-a00a-c58b7ca35a50 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:08.592818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-df307c5f-8990-492c-a037-cd457888114c req-67c7c6d1-4479-4932-a00a-c58b7ca35a50 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:08.607869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-df307c5f-8990-492c-a037-cd457888114c req-67c7c6d1-4479-4932-a00a-c58b7ca35a50 service nova] Creating event network-vif-plugged:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:40:08.617543 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-df307c5f-8990-492c-a037-cd457888114c req-67c7c6d1-4479-4932-a00a-c58b7ca35a50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Nov 22 10:40:08.619844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 423/858] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:40:08.699156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:08.700564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:08.710593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:08.711464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:08.712750 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:08.713514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:08.877892 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:08.889414 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d8b32352-aa8d-4f8e-a011-0e9cb6d1873c tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1514 microversion: 2.1 time: 0.388604 Nov 22 10:40:08.890005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 436/859] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:08 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:08.904714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1715675316", "imageRef": "f07029a7-60f5-4c43-baf0-64175146235d", "flavorRef": "452"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:08.963709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.network.neutron [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] validate_networks() for None {{(pid=122858) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:40:09.512049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:09.520278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4af85f24-2e9a-4588-868d-5dfb434f50fb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.827462 Nov 22 10:40:09.520904 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 424/860] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:08 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:09.525507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:09.526137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:09.532886 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.533316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.534375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.534805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.855517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Flavor limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:40:09.856597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Image limits 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:40:09.856597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Flavor pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:40:09.856597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Image pref 0:0:0 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:40:09.857065 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.virt.hardware [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:40:09.866279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.866732 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.867561 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.868012 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.885226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Getting quotas for project 409fd7e2d1c04bb796b7971b55ec6a74. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:40:09.890319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Getting quotas for user 6eafe048bd1443bfba40debef7f007c5 and project 409fd7e2d1c04bb796b7971b55ec6a74. Resources: {'cores', 'instances', 'ram'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:40:09.901663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Going to run 1 instances... {{(pid=122858) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:40:09.905722 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f07029a7-60f5-4c43-baf0-64175146235d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:40:09.950352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1b8cc061-7836-41e3-b79e-54656d846fac tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049139 Nov 22 10:40:09.951019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 437/861] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:40:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:40:09.955168 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:09.960989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:09.961607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:09.970438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.970897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.971726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:09.972162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:09.984435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:09.986073 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:09.988106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-991062e4-ba94-44fd-9e7c-c6159e9deaa0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1407 microversion: 2.20 time: 0.466246 Nov 22 10:40:09.989077 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 425/862] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:09 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:09.994454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-196c0a41-17ae-4fa5-8ceb-33afb993a72f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:09.995344 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-196c0a41-17ae-4fa5-8ceb-33afb993a72f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:10.114273 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-196c0a41-17ae-4fa5-8ceb-33afb993a72f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:10.127709 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-196c0a41-17ae-4fa5-8ceb-33afb993a72f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1215 microversion: 2.1 time: 0.137210 Nov 22 10:40:10.132183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 426/863] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:09 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:10.345199 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:10.358371 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-02ac6232-f24c-49da-b29e-4b8a2bc3ec90 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1514 microversion: 2.1 time: 0.401259 Nov 22 10:40:10.369419 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 438/864] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:09 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:10.537881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:10.538594 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:10.545012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:10.545465 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:10.546252 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:10.546686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:10.807846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-d7b6dba5-ce5d-42d6-83b7-7d34812e240e req-7b412985-3897-4959-8829-b6e40ad01a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d047109-27a0-4543-b6eb-090c24da838c", "tag": "1f9f89bb-4d09-4294-befd-5f60447d46a9"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:10.810229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:10.810229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:40:10.818519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d7b6dba5-ce5d-42d6-83b7-7d34812e240e req-7b412985-3897-4959-8829-b6e40ad01a37 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:10.819316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-d7b6dba5-ce5d-42d6-83b7-7d34812e240e req-7b412985-3897-4959-8829-b6e40ad01a37 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:10.835699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-d7b6dba5-ce5d-42d6-83b7-7d34812e240e req-7b412985-3897-4959-8829-b6e40ad01a37 service nova] Creating event network-changed:1f9f89bb-4d09-4294-befd-5f60447d46a9 for instance 3d047109-27a0-4543-b6eb-090c24da838c on hv-cinder-80403 Nov 22 10:40:10.841809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-d7b6dba5-ce5d-42d6-83b7-7d34812e240e req-7b412985-3897-4959-8829-b6e40ad01a37 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233408 Nov 22 10:40:10.843321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 439/865] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:10.929673 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:10.940348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-29e43b92-232c-4242-862f-e7342f5c95a5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.405112 Nov 22 10:40:10.943181 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 427/866] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:10 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:11.007504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:11.008234 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:11.015262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.015624 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.016449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.016903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.150691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:11.152217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:11.158802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.159249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.160106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.160733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.286926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:11.296422 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a035a6fb-8236-4251-9866-f55eb34bc9ff tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1275 microversion: 2.1 time: 0.150553 Nov 22 10:40:11.297310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 428/867] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:11 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:11.376403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:11.377010 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:11.383389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.383871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.384659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.385090 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.419025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.419468 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.419964 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lazy-loading 'fault' on Instance uuid cd645b8b-bb68-49af-b7dd-c5ddaa34211d {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:11.427621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:11.436522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:11.438108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:11.439402 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2168e691-26e1-4a93-9183-5445686d2f70 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1597 microversion: 2.20 time: 0.436084 Nov 22 10:40:11.440012 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 440/868] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:40:11 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1597 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:40:11.457863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:11.458341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:11.465113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.465897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.466893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.467654 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.495418 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2613f7c84b1540829f4cdeb9c28b8f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b9423a62144c8a975aacb49a424865', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:11.508755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5abf522d-0ae4-4564-a14a-0ac465bf8b6e tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 200 len: 1309 microversion: 2.1 time: 0.136067 Nov 22 10:40:11.509649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 429/869] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:11 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:11.630001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4327f0e2-068c-43f4-867f-5a7a6e4abc3b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.175904 Nov 22 10:40:11.636846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 441/870] 10.222.0.46 () {60 vars in 1315 bytes} [Mon Nov 22 10:40:11 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:11.960055 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:11.960829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:11.968233 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.969032 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:11.969983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:11.970417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.321796 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:12.322404 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:12.331239 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.331884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.332821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.333259 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.588604 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:12.613066 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-45ce2599-bc17-426a-abf6-ca448ca675e1 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1273 microversion: 2.1 time: 0.301892 Nov 22 10:40:12.614929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 442/871] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:12 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1273 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:12.631474 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:12.632916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] [instance: cd645b8b-bb68-49af-b7dd-c5ddaa34211d] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:12.639813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.640261 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.641247 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.641681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.656940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] HTTP exception thrown: Instance cd645b8b-bb68-49af-b7dd-c5ddaa34211d could not be found. Nov 22 10:40:12.657619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] Returning 404 to user: Instance cd645b8b-bb68-49af-b7dd-c5ddaa34211d could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:40:12.658465 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d20ec599-2379-4edc-96c5-363ed79ac6a9 tempest-VolumesSnapshotTestJSON-1931565032 tempest-VolumesSnapshotTestJSON-1931565032-project] 10.222.0.46 "GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d" status: 404 len: 111 microversion: 2.1 time: 0.040979 Nov 22 10:40:12.659035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 443/872] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:12 2021] GET /compute/v2.1/servers/cd645b8b-bb68-49af-b7dd-c5ddaa34211d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:40:12.664166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:12.665417 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:12.679879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.680705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.681721 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.682381 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.749722 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:12.754188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-23fc2633-c2be-485b-81f1-f2d8b545a535 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.092373 Nov 22 10:40:12.755039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 444/873] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:12 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:12.760211 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-de42d099-2bd5-4f96-9e19-009c94c2b4cf tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.804085 Nov 22 10:40:12.761102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 430/874] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:11 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:12.763580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-871bbc7c-1953-4d02-b6ae-6ecf6f8a6be3 req-ec9e555d-d8ca-45fa-aa3d-cbd8e16d956f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:12.765691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:12.765691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:40:12.774406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-871bbc7c-1953-4d02-b6ae-6ecf6f8a6be3 req-ec9e555d-d8ca-45fa-aa3d-cbd8e16d956f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.775055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-871bbc7c-1953-4d02-b6ae-6ecf6f8a6be3 req-ec9e555d-d8ca-45fa-aa3d-cbd8e16d956f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.789742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-871bbc7c-1953-4d02-b6ae-6ecf6f8a6be3 req-ec9e555d-d8ca-45fa-aa3d-cbd8e16d956f service nova] Creating event network-changed:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:40:12.795980 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-871bbc7c-1953-4d02-b6ae-6ecf6f8a6be3 req-ec9e555d-d8ca-45fa-aa3d-cbd8e16d956f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039643 Nov 22 10:40:12.796559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 445/875] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:12.859364 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-11939626-8def-47fd-b74f-b497906b2682 req-f5ed01c5-0c99-48f9-8ced-4b6aabdafc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd645b8b-bb68-49af-b7dd-c5ddaa34211d", "name": "network-vif-deleted", "tag": "a9364ed3-4993-414b-bbd3-aef1145ba8b5"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:12.861098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:12.861098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:12.869278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-11939626-8def-47fd-b74f-b497906b2682 req-f5ed01c5-0c99-48f9-8ced-4b6aabdafc98 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:12.870052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-11939626-8def-47fd-b74f-b497906b2682 req-f5ed01c5-0c99-48f9-8ced-4b6aabdafc98 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:12.884912 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-11939626-8def-47fd-b74f-b497906b2682 req-f5ed01c5-0c99-48f9-8ced-4b6aabdafc98 service nova] Creating event network-vif-deleted:a9364ed3-4993-414b-bbd3-aef1145ba8b5 for instance cd645b8b-bb68-49af-b7dd-c5ddaa34211d on hv-cinder-80403 Nov 22 10:40:12.891266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-11939626-8def-47fd-b74f-b497906b2682 req-f5ed01c5-0c99-48f9-8ced-4b6aabdafc98 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035956 Nov 22 10:40:12.892495 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 431/876] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:13.632645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:13.633411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:13.641639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.642052 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:13.646356 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.646933 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:13.766786 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:13.767870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:13.775140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.775592 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:13.776505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.777072 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:13.846817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-25f359fc-cb8c-4d6c-a10c-04397568c5b7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.084642 Nov 22 10:40:13.848399 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 432/877] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:13 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:13.854369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:13.855198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:13.867248 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.868515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:13.869980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:13.870787 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:14.046718 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:14.054521 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2f057835-c773-4f8f-bf18-3b2333ff9066 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.426646 Nov 22 10:40:14.055097 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 446/878] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:13 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:14.228059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:14.252504 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1d360e12-6593-4a09-af25-0d295a539fa0 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.401488 Nov 22 10:40:14.265750 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 433/879] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:13 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:14.859413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:14.861045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:14.869564 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:14.870093 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:14.871282 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:14.871606 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:14.909954 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-c104332b-1e01-4439-b185-9f9b44f1f18e req-2ec38de5-6dea-498c-946c-79f7bf66e06b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcae3b6e-a430-4f8e-808f-f8a02a2e48c5", "tag": "bc2655fc-2d3b-4142-aba7-9ba211f6469e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:14.911505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:14.911505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:14.921727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-c104332b-1e01-4439-b185-9f9b44f1f18e req-2ec38de5-6dea-498c-946c-79f7bf66e06b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:14.922165 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-c104332b-1e01-4439-b185-9f9b44f1f18e req-2ec38de5-6dea-498c-946c-79f7bf66e06b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:14.937894 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-c104332b-1e01-4439-b185-9f9b44f1f18e req-2ec38de5-6dea-498c-946c-79f7bf66e06b service nova] Creating event network-changed:bc2655fc-2d3b-4142-aba7-9ba211f6469e for instance dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 on hv-cinder-80403 Nov 22 10:40:14.942966 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-c104332b-1e01-4439-b185-9f9b44f1f18e req-2ec38de5-6dea-498c-946c-79f7bf66e06b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036823 Nov 22 10:40:14.943570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 434/880] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:15.075109 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:15.075835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:15.083808 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:15.084309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:15.085084 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:15.085512 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:15.238905 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:15.246956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d0486eec-b69f-4f38-9926-75a696d415a8 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.177663 Nov 22 10:40:15.247585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 435/881] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:15 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:15.273547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:15.274914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:15.287079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:15.287540 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:15.288460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:15.288921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:15.436523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:15.445448 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d0031930-f72d-4fea-83e3-50788306cb8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.177070 Nov 22 10:40:15.446024 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 436/882] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:15 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:16.265252 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:16.265897 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:16.272714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:16.273162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:16.273944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:16.274369 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:16.425981 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:16.434238 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7d47f79d-ff93-4f2b-b8e0-f738da209c14 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.173390 Nov 22 10:40:16.435001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 437/883] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:16 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:16.465070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:16.465720 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:16.474502 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:16.474984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:16.475991 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:16.476505 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:16.625723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:16.635158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-932b8cac-3252-4508-973c-fdc32a40ab53 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.173630 Nov 22 10:40:16.635948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 438/884] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:16 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:17.272788 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a3f3d5c2-ecec-46bc-8f48-e586ac7d7223 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 2.417578 Nov 22 10:40:17.273394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 447/885] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:14 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 2419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:17.454310 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:17.454959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:17.462000 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:17.462455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:17.463298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:17.463764 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:17.654596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:17.654596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:17.662699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:17.663522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:17.665343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:17.665817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:17.685868 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:17.696725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-de9a798a-db9e-4908-8b97-a6cafda03a1a tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.247969 Nov 22 10:40:17.697531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 439/886] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:17 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:17.920930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:17.929302 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e82f52a7-0e20-4b38-b5ab-5a73cf37110e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.279931 Nov 22 10:40:17.929889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 448/887] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:17 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:18.284226 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:18.285313 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:18.293205 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.293693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:18.294509 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.295531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:18.367371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4f2efc43-9d98-4241-806f-4b84660b038c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.086800 Nov 22 10:40:18.368117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 440/888] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:18 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:18.717645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:18.718305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:18.725683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.726500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:18.727344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.727861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:18.934500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:18.946724 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7cd5744d-4d89-40c1-a500-290ade4f8cf9 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.234064 Nov 22 10:40:18.947587 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 449/889] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:18 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:18.949014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:18.949890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:18.957718 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.958436 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:18.959359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:18.959844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:19.150685 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:19.162829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-570e326a-f317-49ad-9061-097609aa9c50 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.218720 Nov 22 10:40:19.163873 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 441/890] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:18 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:19.379472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:19.380468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:19.388112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:19.388663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:19.389874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:19.390374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:19.464174 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-364a2cba-7adb-45d3-abdb-f994d3b970bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.088248 Nov 22 10:40:19.465152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 450/891] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:19 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:19.644360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-a1ec7cdb-34e5-49de-a5b4-ba06ca875744 req-2d63cc77-47b8-4383-80d5-169b86a071dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d047109-27a0-4543-b6eb-090c24da838c", "name": "network-vif-plugged", "status": "completed", "tag": "1f9f89bb-4d09-4294-befd-5f60447d46a9"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:19.645960 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:19.645960 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:19.653556 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-a1ec7cdb-34e5-49de-a5b4-ba06ca875744 req-2d63cc77-47b8-4383-80d5-169b86a071dd service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:19.654047 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-a1ec7cdb-34e5-49de-a5b4-ba06ca875744 req-2d63cc77-47b8-4383-80d5-169b86a071dd service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:19.667192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-a1ec7cdb-34e5-49de-a5b4-ba06ca875744 req-2d63cc77-47b8-4383-80d5-169b86a071dd service nova] Creating event network-vif-plugged:1f9f89bb-4d09-4294-befd-5f60447d46a9 for instance 3d047109-27a0-4543-b6eb-090c24da838c on hv-cinder-80403 Nov 22 10:40:19.672958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-a1ec7cdb-34e5-49de-a5b4-ba06ca875744 req-2d63cc77-47b8-4383-80d5-169b86a071dd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107655 Nov 22 10:40:19.673623 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 442/892] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:19.968269 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:19.969327 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:19.978130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:19.978588 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:19.979368 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:19.979834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:20.127531 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:20.135286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c5d935c5-e653-475e-ad47-1a075cb8c674 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.171493 Nov 22 10:40:20.135910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 451/893] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:19 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:20.183560 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:20.184150 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:20.190694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:20.191151 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:20.191971 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:20.192398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:20.346661 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:20.354533 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2fbe512b-fef8-4237-a736-93fc48487005 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1362 microversion: 2.1 time: 0.175644 Nov 22 10:40:20.355104 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 443/894] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:20 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:20.475987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:20.477097 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:20.486292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:20.486815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:20.488078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:20.488794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:20.559785 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1420d0a5-94db-464e-988a-f197c7cf48d7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.087419 Nov 22 10:40:20.560424 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 452/895] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:20 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:21.152236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:21.152948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:21.160407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.161071 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.162400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.162987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.320420 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:21.329058 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7da7e17e-e79e-4c8c-b531-ac8a062db243 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.180491 Nov 22 10:40:21.338930 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 444/896] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:21 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:21.380206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:21.383874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:21.392618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.394158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.395258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.396061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.567830 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:21.572450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:21.573781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:21.578148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-403154a7-8fe1-4169-a117-1a85b6552bf1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1548 microversion: 2.1 time: 0.206146 Nov 22 10:40:21.578731 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 453/897] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:21 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1548 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:21.581944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.582677 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.583198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.583630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.596202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:21.596742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:21.603814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.604217 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.605082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:21.605749 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:21.647098 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-951d9110-805d-4baa-baec-92d2884ff7cf tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.079360 Nov 22 10:40:21.647712 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 445/898] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:21 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:21.710001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-47156db5-0796-4f68-a02e-6cf67f078d27 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118257 Nov 22 10:40:21.710621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 454/899] 10.222.0.46 () {58 vars in 1274 bytes} [Mon Nov 22 10:40:21 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:22.348747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:22.349479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:22.358522 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.358987 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.359831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.360467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.629981 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:22.642990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ee48fe88-9ea4-4125-b08b-ca4c898694fc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.297913 Nov 22 10:40:22.642990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 446/900] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:22 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:22.658793 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:22.660073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:22.666631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.667085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.667955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.668699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.750635 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0ccd00d6-50c4-4092-b4ac-5f09495b31b5 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.096341 Nov 22 10:40:22.751492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 455/901] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:22 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:22.856762 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:22.858832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:22.864926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.865385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.866229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.866668 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.867119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-6da90c4e-3346-4ced-8b8a-1e4373e59a33 req-3aa54e1d-1b23-426d-a96d-c4644207abba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d047109-27a0-4543-b6eb-090c24da838c", "tag": "1f9f89bb-4d09-4294-befd-5f60447d46a9"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:22.868953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:22.868953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:40:22.878458 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6da90c4e-3346-4ced-8b8a-1e4373e59a33 req-3aa54e1d-1b23-426d-a96d-c4644207abba service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:22.878896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6da90c4e-3346-4ced-8b8a-1e4373e59a33 req-3aa54e1d-1b23-426d-a96d-c4644207abba service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:22.892727 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-6da90c4e-3346-4ced-8b8a-1e4373e59a33 req-3aa54e1d-1b23-426d-a96d-c4644207abba service nova] Creating event network-changed:1f9f89bb-4d09-4294-befd-5f60447d46a9 for instance 3d047109-27a0-4543-b6eb-090c24da838c on hv-cinder-80403 Nov 22 10:40:22.899396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-6da90c4e-3346-4ced-8b8a-1e4373e59a33 req-3aa54e1d-1b23-426d-a96d-c4644207abba service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042181 Nov 22 10:40:22.900070 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 456/902] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:23.659384 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:23.660203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:23.666759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:23.667215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:23.668063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:23.668511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:23.826697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:23.834612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0a175771-6c9b-46bd-a3d0-c9b2749e6ca4 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.179859 Nov 22 10:40:23.835202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 457/903] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:23 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:23.840173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:23.841095 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:23.851636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:23.852701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:23.853594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:23.854030 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.876531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b424b3f0-ffc4-4221-9041-4092cbf941d7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 3.023082 Nov 22 10:40:25.880210 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 447/904] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:22 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 3025 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:25.881694 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4e8fa857-1e96-401e-bc2f-aeb9880ee608 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 2.044876 Nov 22 10:40:25.882557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 458/905] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:23 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:25.883493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-3e7b5b42-ac4b-4c04-869f-3276b73faff8 req-6a6731e7-9496-4875-8325-46101dc6da99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcae3b6e-a430-4f8e-808f-f8a02a2e48c5", "name": "network-vif-plugged", "status": "completed", "tag": "bc2655fc-2d3b-4142-aba7-9ba211f6469e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:25.885091 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:25.885091 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:25.889765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:25.890627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:25.893432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3e7b5b42-ac4b-4c04-869f-3276b73faff8 req-6a6731e7-9496-4875-8325-46101dc6da99 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:25.893849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-3e7b5b42-ac4b-4c04-869f-3276b73faff8 req-6a6731e7-9496-4875-8325-46101dc6da99 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.899142 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:25.899693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.900549 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:25.901053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.906506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-3e7b5b42-ac4b-4c04-869f-3276b73faff8 req-6a6731e7-9496-4875-8325-46101dc6da99 service nova] Creating event network-vif-plugged:bc2655fc-2d3b-4142-aba7-9ba211f6469e for instance dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 on hv-cinder-80403 Nov 22 10:40:25.914112 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-3e7b5b42-ac4b-4c04-869f-3276b73faff8 req-6a6731e7-9496-4875-8325-46101dc6da99 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034883 Nov 22 10:40:25.914731 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 448/906] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:25.920407 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:25.921040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:25.927809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:25.928486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.929427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:25.930040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:25.957019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lazy-loading 'flavor' on Instance uuid f79ad0cd-bef2-49ee-92cb-c20e41b3cedf {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:26.041334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-85f8f14b-f76b-4643-89a2-1bba2cb5259e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "POST /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf/action" status: 202 len: 0 microversion: 2.1 time: 0.125029 Nov 22 10:40:26.041925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 449/907] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:25 2021] POST /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:26.051248 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:26.052126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:26.058444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.058911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.059716 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.060190 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.229618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:26.237758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7a4b8738-c96a-47a5-85ae-e2c51731e9a7 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.353335 Nov 22 10:40:26.238369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 459/908] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:25 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:26.390104 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:26.398424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b4c3d912-5f13-4ee7-a83a-f26e3b22d6d1 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.351466 Nov 22 10:40:26.398998 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 450/909] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:26 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:26.892286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:26.893751 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:26.894461 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:26.895385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:26.902462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.902902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.904768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.904768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.906761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.907517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.908536 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:26.909297 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:26.976434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d490c852-9718-44c5-9356-11fbd975fd64 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 14 microversion: 2.20 time: 0.086281 Nov 22 10:40:26.977590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 451/910] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:26 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:26.983809 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a8004e6b-ac62-48e2-b91d-94ab656f0288 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.098761 Nov 22 10:40:26.984604 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 460/911] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:26 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:40:27.257997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:27.258601 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:27.271201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:27.271201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:27.271733 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:27.271833 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:27.421344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:27.422059 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:27.431705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:27.432294 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:27.433385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:27.433598 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:27.433986 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:27.443725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-131d2a18-ddc8-4ad1-b802-e1201d053fcc tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1315 microversion: 2.1 time: 0.189869 Nov 22 10:40:27.444754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 452/912] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:27 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:27.588831 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:27.598813 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5a72a015-cf52-4de8-ad84-a7b2f874e851 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.182885 Nov 22 10:40:27.599613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 461/913] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:27 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:27.989318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:27.990485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.000231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.000949 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.001682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:28.002231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.002567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.002810 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.010339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.010936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.011793 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.012229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.091443 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ea56db2a-5afd-4d5a-a106-e0c994d09369 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 3277 microversion: 2.20 time: 0.106328 Nov 22 10:40:28.096109 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 453/914] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:27 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 3277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:40:28.096288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a9f90913-5711-409b-89b1-7c3dc34cba2e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.098882 Nov 22 10:40:28.097039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 462/915] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:27 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:28.463027 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:28.463814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.473245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.473721 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.474512 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.474940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.620161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:28.620875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.628963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.629427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.630238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.630678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.631307 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:28.641183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-02c19625-d7bc-494e-a7d3-014dacf977d0 tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1464 microversion: 2.1 time: 0.182835 Nov 22 10:40:28.646781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 454/916] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:28 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1464 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:28.682057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:28.682724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.689593 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.690140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.691029 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.691563 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.721503 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:40:28.789483 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:28.798962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0858fd7c-9ee4-442c-8de0-a87d8c6a5c14 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.183296 Nov 22 10:40:28.800131 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 463/917] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:28 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:28.814214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7cca5137-c8ec-4693-92cc-a3ecc8efc74b tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "DELETE /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 204 len: 0 microversion: 2.1 time: 0.135845 Nov 22 10:40:28.815055 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 455/918] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:40:28 2021] DELETE /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:40:28.824836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:28.825383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:28.831842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.832289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.833086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:28.833519 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:28.986670 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:28.994756 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b52f259e-de60-43ac-8ef3-7da1fd24bd8e tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1470 microversion: 2.1 time: 0.173992 Nov 22 10:40:28.996107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 464/919] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:28 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:29.104932 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:29.105963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:29.108045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:29.109079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:29.114083 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.114576 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.115385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.115851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.116273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.116739 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.117807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.118246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.193504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7a722261-d089-42d1-8692-21fd3ce42076 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.089172 Nov 22 10:40:29.194048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 465/920] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:29 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:29.228724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8eb2c641-343e-43e3-8e34-14868de51ca7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 11454 microversion: 2.20 time: 0.127808 Nov 22 10:40:29.229372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 456/921] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:29 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 11454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:29.819510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:29.820113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:29.828316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.828779 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.829708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:29.830016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:29.972518 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:29.980370 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-93d03bff-b5b7-411c-90e1-251032acc649 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.165151 Nov 22 10:40:29.980926 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 466/922] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:29 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:30.014061 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:30.014760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:30.022034 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.022483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.023269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.023695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.164097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:30.172143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2485ffd4-577b-4168-b244-093509861e4c tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1470 microversion: 2.1 time: 0.162493 Nov 22 10:40:30.172727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 457/923] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:30 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:30.205405 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:30.206355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:30.213361 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.213808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.214597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.215039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.240052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:30.240980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:30.249388 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.250158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.251263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:30.251700 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:30.285652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b621711d-7376-4c62-8d5d-0a04a92aaf22 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.084256 Nov 22 10:40:30.286303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 467/924] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:30 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:30.357320 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-88542346-00d2-4dae-af72-2105b26f181f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 16877 microversion: 2.20 time: 0.120768 Nov 22 10:40:30.357984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 458/925] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:30 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 16877 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:30.998753 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:30.999994 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:31.010393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.010848 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.011697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.012440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.059305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-da69f844-91d9-478e-8e7a-669dcbcb232c req-2d945d3c-ef42-4c6b-b3cf-25b2439099bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcae3b6e-a430-4f8e-808f-f8a02a2e48c5", "name": "network-vif-deleted", "tag": "bc2655fc-2d3b-4142-aba7-9ba211f6469e"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:31.061608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:31.061608 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:31.077333 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-da69f844-91d9-478e-8e7a-669dcbcb232c req-2d945d3c-ef42-4c6b-b3cf-25b2439099bf service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.077792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-da69f844-91d9-478e-8e7a-669dcbcb232c req-2d945d3c-ef42-4c6b-b3cf-25b2439099bf service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.090479 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-da69f844-91d9-478e-8e7a-669dcbcb232c req-2d945d3c-ef42-4c6b-b3cf-25b2439099bf service nova] Creating event network-vif-deleted:bc2655fc-2d3b-4142-aba7-9ba211f6469e for instance dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 on hv-cinder-80403 Nov 22 10:40:31.097604 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-da69f844-91d9-478e-8e7a-669dcbcb232c req-2d945d3c-ef42-4c6b-b3cf-25b2439099bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042030 Nov 22 10:40:31.098252 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 459/926] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:31.193724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:31.195174 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:31.203108 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.204023 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.204909 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.205498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.216492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:31.225584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-aa343c19-6621-4a80-bd6b-7831de7749e4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.231511 Nov 22 10:40:31.232126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 468/927] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:30 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:31.244214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.244653 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.245092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lazy-loading 'fault' on Instance uuid dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:31.285450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eafe048bd1443bfba40debef7f007c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '409fd7e2d1c04bb796b7971b55ec6a74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:31.293298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9242d55c-4e69-43df-9f8d-363bb6fdd4ef tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 200 len: 1305 microversion: 2.1 time: 0.105632 Nov 22 10:40:31.293871 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 460/928] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:31 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:31.297848 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:31.298992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:31.305685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.306131 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.306921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.307352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.366835 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fc5f51be-3f14-4bd9-b7bb-6ca89a1fcf5e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.072924 Nov 22 10:40:31.367484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 469/929] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:31 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:31.369392 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:31.370330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:31.377114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.377555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.378386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:31.378811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:31.457517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8cb0f5a8-105e-4d50-8369-1ba184acca74 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 17861 microversion: 2.20 time: 0.091864 Nov 22 10:40:31.458156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 461/930] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:31 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 17861 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:32.243780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:32.244489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:32.252271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.252730 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.253514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.253941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.312093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:32.312916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] [instance: dcae3b6e-a430-4f8e-808f-f8a02a2e48c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:32.320906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.321451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.322342 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.322851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.339839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] HTTP exception thrown: Instance dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 could not be found. Nov 22 10:40:32.339839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] Returning 404 to user: Instance dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:40:32.340941 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-58b50f6b-60d8-4acf-aa60-02259f851a4f tempest-VolumesNegativeTest-1963349979 tempest-VolumesNegativeTest-1963349979-project] 10.222.0.46 "GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5" status: 404 len: 111 microversion: 2.1 time: 0.033699 Nov 22 10:40:32.342103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 462/931] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:32 2021] GET /compute/v2.1/servers/dcae3b6e-a430-4f8e-808f-f8a02a2e48c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:40:32.380148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:32.381201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:32.389030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.390157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.391038 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.391538 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.404277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:32.412208 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-29a48597-8331-43e3-a872-b6518df8795a tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.172774 Nov 22 10:40:32.413030 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 470/932] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:32 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:32.466703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-381d002d-8af5-41b5-8638-f84ad92853eb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.091291 Nov 22 10:40:32.470403 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 463/933] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:32 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:32.471108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:32.471108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:32.477801 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.478479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.479514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:32.480075 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:32.557373 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e8679ad3-1175-4213-9849-a460475a5a51 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 19841 microversion: 2.20 time: 0.091458 Nov 22 10:40:32.557961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 471/934] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:32 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 19841 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:33.430385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:33.431309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:33.438853 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.439311 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.440127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.440566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.479413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:33.481502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:33.489064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.489735 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.490758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.491458 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.558170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b4caa606-8d44-4bc5-ae8e-40f28863799e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.083277 Nov 22 10:40:33.561343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 472/935] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:33 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:40:33.571419 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:33.572905 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:33.580981 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.581435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.582228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:33.583086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:33.592302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:33.600731 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a38e9e20-c0b8-4e42-84d6-00cfd7b4409d tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.174660 Nov 22 10:40:33.601660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 464/936] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:33 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:33.660091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-05f46851-5a83-4d09-9f09-ba69ae732b3d tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 22168 microversion: 2.20 time: 0.093221 Nov 22 10:40:33.664101 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 473/937] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:33 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 22168 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:40:34.569500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:34.570424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:34.577304 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.577763 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.578547 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.578996 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.618883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:34.619698 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:34.627456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.627934 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.628723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.629159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.643845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-98ce1a21-a481-4567-b0a9-f0087338ea34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 14 microversion: 2.1 time: 0.077826 Nov 22 10:40:34.645301 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 465/938] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:34 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:34.672155 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:34.673354 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:34.680566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.681099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.681976 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:34.682636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:34.767208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2272fa36-a081-44fa-b423-5008a8430126 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 23300 microversion: 2.20 time: 0.098776 Nov 22 10:40:34.768449 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 466/939] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:34 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 23300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:40:34.777400 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:34.787130 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6cb62829-539d-4890-a920-d7ed64eb2453 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.172385 Nov 22 10:40:34.787937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 474/940] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:34 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:35.656282 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:35.657263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:35.668819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.669460 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.670738 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.671453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.752106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f76aed8b-45ec-4328-9004-2a0c992581da tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 6451 microversion: 2.1 time: 0.099546 Nov 22 10:40:35.752810 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 467/941] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:35 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 6451 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:35.779161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:35.780184 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:35.789571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.790124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.791487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.792206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.810267 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:35.810981 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:35.819687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.820143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.820963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:35.821423 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:35.884091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-63542579-f76c-47d3-810e-746f95b9ecf0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 24607 microversion: 2.20 time: 0.108713 Nov 22 10:40:35.884884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 475/942] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:35 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 24607 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:35.983488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:35.991606 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3bb97896-761e-4d23-939b-2b05675dd926 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.186646 Nov 22 10:40:35.992229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 468/943] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:35 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:36.764705 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:36.766126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:36.773818 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:36.774361 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:36.775260 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:36.776109 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:36.867140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f4f08db5-d6e7-4bd4-9e2a-a03741076260 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 13732 microversion: 2.1 time: 0.106501 Nov 22 10:40:36.872165 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 476/944] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:36 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 13732 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:36.901374 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:36.903250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:36.914158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:36.914747 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:36.915849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:36.916591 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:37.003947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e3eb655d-b8d1-48e4-adee-12d8d3ffa885 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 25780 microversion: 2.20 time: 0.110307 Nov 22 10:40:37.008506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 469/945] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:36 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 25780 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:37.013678 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:37.015295 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:37.041342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:37.041765 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:37.042593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:37.043026 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:37.288564 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:37.298049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-626f11ef-7255-4bb2-ab94-0624c448fe98 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.291644 Nov 22 10:40:37.307925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 477/946] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:37 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:37.880834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:37.881847 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:37.889240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:37.889692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:37.890518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:37.890943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:37.961988 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f400cda0-0db0-4563-b9aa-856da798b171 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 18013 microversion: 2.1 time: 0.085324 Nov 22 10:40:37.962684 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 470/947] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:37 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 18013 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:38.016533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:38.017502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:38.024729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.025185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:38.025976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.026408 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:38.125897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-79c032c7-4ea0-47f5-ab2f-f4b02845aec4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 26941 microversion: 2.20 time: 0.113027 Nov 22 10:40:38.126737 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 478/948] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:38 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 26941 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:38.317493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:38.318133 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:38.325599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.326042 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:38.326823 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.327249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:38.472631 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:38.480829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f803e5f9-a7b9-4019-877a-ebf6ad1fffe8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.167853 Nov 22 10:40:38.481453 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 471/949] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:38 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:38.979939 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:38.981283 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:38.990946 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.991396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:38.992213 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:38.992645 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.068573 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ab0563a1-b6a0-4ac5-8da1-fc56d43d9f85 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 19133 microversion: 2.1 time: 0.097323 Nov 22 10:40:39.069321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 479/950] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:38 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 19133 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:39.138705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:39.139626 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:39.146972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.147430 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.148257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.148685 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.231584 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a1c52903-ca0a-4d0f-8552-8a0739e889bd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 27539 microversion: 2.20 time: 0.096472 Nov 22 10:40:39.232541 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 472/951] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:39 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 27539 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:39.499266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:39.499938 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:39.507819 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.508257 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.509072 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.509510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.649323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:39.657285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0f3aa945-7926-46d2-8ebc-ecb74a5e9132 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1569 microversion: 2.1 time: 0.162267 Nov 22 10:40:39.658015 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 480/952] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:39 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:39.674610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:39.675182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:39.682456 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.682950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.683770 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.684200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.769908 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a8b2816f-7941-45d0-a5f8-0389ac3b2f88 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "POST /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf/action" status: 202 len: 0 microversion: 2.1 time: 0.099533 Nov 22 10:40:39.770748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 473/953] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:39 2021] POST /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:39.779060 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:39.780082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:39.787183 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.787953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.788961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:39.789605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:39.952203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:39.960387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3143a5d1-4ed6-4121-833f-a2f5682016d5 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1517 microversion: 2.1 time: 0.185539 Nov 22 10:40:39.960975 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 481/954] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:39 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:40.081324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:40.082240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:40.088556 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.089010 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:40.089922 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.090356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:40.176732 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-698c5599-0af6-40e9-8ff8-797b02924d1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 21288 microversion: 2.1 time: 0.099576 Nov 22 10:40:40.177417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 474/955] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:40 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 21288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:40.244094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:40.245025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:40.252228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.252666 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:40.253459 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.253887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:40.341599 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b81c2cde-c243-48b9-a7c8-8627e61f37be tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 27959 microversion: 2.20 time: 0.101058 Nov 22 10:40:40.342287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 482/956] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:40 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 27959 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:40.978950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:40.979526 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:40.987286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.987820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:40.988595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:40.989020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:41.158170 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:41.166878 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7b9ad6ac-478a-41c5-a17f-a93c6e9ac941 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.192036 Nov 22 10:40:41.167469 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 475/957] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:40 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:41.190257 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:41.191339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:41.199543 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:41.200061 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:41.200855 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:41.201302 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:41.279004 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d9d18ff1-e8b0-4057-8ed0-e1bc9c47ad86 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 22981 microversion: 2.1 time: 0.093125 Nov 22 10:40:41.279758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 483/958] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:41 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 22981 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:41.354732 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:41.355691 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:41.363136 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:41.363581 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:41.364492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:41.364924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:41.447724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9a7e336c-1ff4-4d28-8754-76ba51f9535a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28205 microversion: 2.20 time: 0.096763 Nov 22 10:40:41.448412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 476/959] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:41 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28205 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:42.186322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:42.186931 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:42.195379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.195968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.197091 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.197603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.291467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:42.293113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:42.300376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.300802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.301605 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.302030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.351533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:42.360981 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db144a56-196c-4717-ba62-733493a8d286 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.178557 Nov 22 10:40:42.361750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 484/960] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:42 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:42.379410 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d0e2c788-b84a-4f73-b4bc-f505d460ed8c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 24405 microversion: 2.1 time: 0.092155 Nov 22 10:40:42.380108 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 477/961] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:42 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 24405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:40:42.460966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:42.461794 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:42.469291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.469607 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.470485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.471058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.552475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e443f624-c5dd-4056-93e2-622742df8d6a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28205 microversion: 2.20 time: 0.094768 Nov 22 10:40:42.555317 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 485/962] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:42 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28205 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:42.703525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-225268498"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:42.704236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:42.713477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.713959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.714757 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:42.715187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:42.867832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.network.security_group_api [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Removing security group cb9f1571-aa6d-43fe-a22d-0d0ac84f7907 from port 326eedf5-8a3e-4e3a-887c-a2d57a212dc8 Nov 22 10:40:43.245649 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0ebb955f-68ec-47cc-91cc-6c0655e5dfa9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action" status: 202 len: 0 microversion: 2.1 time: 0.546696 Nov 22 10:40:43.251345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 478/963] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:42 2021] POST /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:43.263322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-1397f543-49d3-4156-bea9-7d8638af6b1c req-042089da-3bf1-47f0-b5a7-3a76bc5fe4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:43.268137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:43.268137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:40:43.278363 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-1397f543-49d3-4156-bea9-7d8638af6b1c req-042089da-3bf1-47f0-b5a7-3a76bc5fe4ee service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.279143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-1397f543-49d3-4156-bea9-7d8638af6b1c req-042089da-3bf1-47f0-b5a7-3a76bc5fe4ee service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.303433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-1397f543-49d3-4156-bea9-7d8638af6b1c req-042089da-3bf1-47f0-b5a7-3a76bc5fe4ee service nova] Creating event network-changed:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:40:43.311533 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-1397f543-49d3-4156-bea9-7d8638af6b1c req-042089da-3bf1-47f0-b5a7-3a76bc5fe4ee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055177 Nov 22 10:40:43.313051 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 486/964] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:43.378474 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:43.379114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:43.391752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:43.392817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:43.397514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.398028 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.398803 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.399248 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.406046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.406507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.407496 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.407996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.539110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0893848c-de92-4233-86a3-7c9282e868af tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 25900 microversion: 2.1 time: 0.152027 Nov 22 10:40:43.540527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 487/965] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:43 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 25900 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:40:43.571555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:43.573335 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:43.590959 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.592025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.594352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.596591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.689129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ee98751b-4469-4cfa-adb0-0e8d5583e588 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28496 microversion: 2.20 time: 0.125920 Nov 22 10:40:43.690883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 488/966] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:43 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28496 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:43.710719 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-6da4b780-b501-437c-b7d3-f2b3b2415753 req-8d8bdb6f-0bd0-451a-83f7-3d0f0f22d952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "name": "network-vif-unplugged", "status": "completed", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:43.712279 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:43.713696 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:43.713696 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:40:43.721561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a564dcbc-0551-49e6-9a9b-b69fa621ee10 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.346876 Nov 22 10:40:43.724715 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 479/967] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:43 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:43.727319 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6da4b780-b501-437c-b7d3-f2b3b2415753 req-8d8bdb6f-0bd0-451a-83f7-3d0f0f22d952 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:43.727467 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6da4b780-b501-437c-b7d3-f2b3b2415753 req-8d8bdb6f-0bd0-451a-83f7-3d0f0f22d952 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:43.750688 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-6da4b780-b501-437c-b7d3-f2b3b2415753 req-8d8bdb6f-0bd0-451a-83f7-3d0f0f22d952 service nova] Creating event network-vif-unplugged:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:40:43.758729 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-6da4b780-b501-437c-b7d3-f2b3b2415753 req-8d8bdb6f-0bd0-451a-83f7-3d0f0f22d952 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057415 Nov 22 10:40:43.759833 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 489/968] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:44.556831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:44.557842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:44.565069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.565524 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.566308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.566727 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.655197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c7c8fedc-38e4-45e0-a2ea-5d79c6aa8877 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 27123 microversion: 2.1 time: 0.101943 Nov 22 10:40:44.659693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 480/969] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:44 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 27123 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:44.702288 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:44.703372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:44.710504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.710934 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.711771 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.712225 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.742426 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:44.743241 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:44.751114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.751568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.752646 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.753303 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.801000 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e9da5a58-6e44-499b-a6f8-bfac5146bfd4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28663 microversion: 2.20 time: 0.100936 Nov 22 10:40:44.801000 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 490/970] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:44 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28663 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:44.805989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:44.806664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:44.814603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.815157 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.816100 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:44.816608 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:44.911500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lazy-loading 'services' on Instance uuid cc98df96-7387-4b77-a13e-8f8bce4fba68 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:44.921537 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:44.930464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1038722a-1e24-4aba-9e21-f2ee59443ea2 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.192319 Nov 22 10:40:44.931171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 481/971] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:44 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:45.006421 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-07d50079-1f1b-444a-a8ec-0102987c11b7 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments/509cbd20-2771-4c6d-aa89-772a09884988" status: 202 len: 0 microversion: 2.1 time: 0.204737 Nov 22 10:40:45.007475 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 491/972] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:40:44 2021] DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments/509cbd20-2771-4c6d-aa89-772a09884988 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:45.030318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:45.032376 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:45.039637 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.040111 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.040918 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.041345 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.076896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8839ec25-cef9-4df8-93f1-2108e1364b84 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053906 Nov 22 10:40:45.077530 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 492/973] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:40:45 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:45.152087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-92cc17fe-b846-41dd-a797-c2c53a1500bc req-0100512e-f915-4730-856d-5dbb146be49d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:45.154508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:45.154508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:45.164531 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-92cc17fe-b846-41dd-a797-c2c53a1500bc req-0100512e-f915-4730-856d-5dbb146be49d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.165162 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-92cc17fe-b846-41dd-a797-c2c53a1500bc req-0100512e-f915-4730-856d-5dbb146be49d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.177308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-92cc17fe-b846-41dd-a797-c2c53a1500bc req-0100512e-f915-4730-856d-5dbb146be49d service nova] Creating event network-changed:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:40:45.183811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-92cc17fe-b846-41dd-a797-c2c53a1500bc req-0100512e-f915-4730-856d-5dbb146be49d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250816 Nov 22 10:40:45.184816 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 482/974] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:45.666515 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:45.667651 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:45.674056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.674581 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.675351 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.675845 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.760481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-133cd511-ffa0-4bc0-9d28-06d1c7d93406 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 27599 microversion: 2.1 time: 0.096993 Nov 22 10:40:45.767863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 493/975] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:45 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 27599 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:45.812087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:45.813881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:45.821046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.821809 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.822681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.823891 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.900069 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-65c5f677-fde1-4e60-9238-2e6061c9ae8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28663 microversion: 2.20 time: 0.092400 Nov 22 10:40:45.900694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 483/976] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:45 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28663 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:45.948632 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:45.949248 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:45.957120 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.957560 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:45.958355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:45.958771 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.090148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:46.091184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:46.099469 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.099963 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.100797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.101245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.112612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:46.122224 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-68fd0bc3-9762-4e61-9d73-e2245b1780d6 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.177698 Nov 22 10:40:46.122781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 494/977] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:45 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:46.136079 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ba9b6cfd-fd35-46d9-acfb-e0a8073dbcf6 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050106 Nov 22 10:40:46.136658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 484/978] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:40:46 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:40:46.146896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:46.147389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:46.154490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.154934 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.155764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.156191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.234416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] HTTP exception thrown: Instance cc98df96-7387-4b77-a13e-8f8bce4fba68 is not attached to volume 509cbd20-2771-4c6d-aa89-772a09884988 Nov 22 10:40:46.235140 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Returning 404 to user: Instance cc98df96-7387-4b77-a13e-8f8bce4fba68 is not attached to volume 509cbd20-2771-4c6d-aa89-772a09884988 {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:40:46.236847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3699ba2d-0e17-4046-b71d-fd9f0058b172 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments/509cbd20-2771-4c6d-aa89-772a09884988" status: 404 len: 154 microversion: 2.1 time: 0.093861 Nov 22 10:40:46.237420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 495/979] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:40:46 2021] DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68/os-volume_attachments/509cbd20-2771-4c6d-aa89-772a09884988 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:40:46.774872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:46.775697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:46.782895 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.783352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.784204 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.784666 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.876665 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-229f274c-6ba5-40da-9e01-8d105a1905c7 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 27944 microversion: 2.1 time: 0.105211 Nov 22 10:40:46.877807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 485/980] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:46 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 27944 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:46.912262 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:46.913117 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:46.920405 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.920847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.921615 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:46.922038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:46.989341 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5c931397-cd42-410e-9298-fda2c300848e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28663 microversion: 2.20 time: 0.080765 Nov 22 10:40:46.990003 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 496/981] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:46 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28663 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:47.140938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:47.141718 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:47.152794 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.153243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.154031 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.154462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.318251 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:47.326349 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5d00e4cf-dd25-4553-97d9-a866f5b13409 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.189619 Nov 22 10:40:47.326911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 486/982] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:47 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:47.375350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:47.376000 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:47.383273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.383772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.384558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.384990 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.410509 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:40:47.498109 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1dfd003e-0ee0-4e71-82f8-fcb1c1cd51fe tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 204 len: 0 microversion: 2.1 time: 0.126656 Nov 22 10:40:47.498816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 497/983] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:40:47 2021] DELETE /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:40:47.507561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:47.508220 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:47.514635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.515076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.515884 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.516311 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.661196 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:47.668827 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-75b0cee7-68eb-4a9d-ba3f-7b55eae37465 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1554 microversion: 2.1 time: 0.164882 Nov 22 10:40:47.669363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 487/984] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:47 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:47.890161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:47.891411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:47.898421 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.898869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.899697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:47.900159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:47.985143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f794c535-574e-4a67-8a12-9a5bf85cd868 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28241 microversion: 2.1 time: 0.099184 Nov 22 10:40:47.986623 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 498/985] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:47 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:48.001752 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:48.002765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:48.009810 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.010672 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.011637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.012118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.100965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7575ce67-2f31-470b-9160-13581672b451 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 28695 microversion: 2.20 time: 0.103272 Nov 22 10:40:48.101618 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 488/986] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:47 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 28695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:48.344679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:48.345287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:48.352866 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.353338 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.354253 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.354683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.497281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:48.505600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2c819095-943f-4b58-ab8f-282d3a4d1b7e tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1575 microversion: 2.1 time: 0.165469 Nov 22 10:40:48.506195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 499/987] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:48 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:48.687864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:48.688632 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:48.695805 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.696260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.697068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:48.697497 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:48.838636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:48.847760 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3eb596c8-7312-4519-af65-8c07efcd7812 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1554 microversion: 2.1 time: 0.164024 Nov 22 10:40:48.848349 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 489/988] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:48 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:48.998049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:48.998927 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:49.010502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.011173 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.012485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.013137 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.093095 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-60701570-de85-4103-bf66-b65461d7d84d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28241 microversion: 2.1 time: 0.098873 Nov 22 10:40:49.093767 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 500/989] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:48 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:49.113140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:49.114184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:49.120943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.121471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.122344 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.122770 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.207090 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4384be96-6df7-446d-957c-83bc85bd6c76 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 30376 microversion: 2.20 time: 0.097606 Nov 22 10:40:49.207773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 490/990] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:49 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 30376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:49.523314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:49.524035 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:49.531372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.531847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.532748 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.533177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.683304 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:49.693628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f3388476-16b0-4214-aaa4-c2eca4dc4b8c tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1562 microversion: 2.1 time: 0.174518 Nov 22 10:40:49.694469 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 501/991] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:49 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:49.867561 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:49.868329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:49.877272 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.877508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:49.878286 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:49.878814 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:50.106571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:50.108374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:50.115610 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:50.116396 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:50.117735 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:50.118175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:50.212144 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2a6237cf-09bc-43f7-88ca-32eb3a722596 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28531 microversion: 2.1 time: 0.109190 Nov 22 10:40:50.213600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 502/992] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:50 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28531 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:40:50.227069 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:50.228834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:50.241245 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:50.242052 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:50.243488 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:50.244328 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:50.312397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:50.320807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-10c213ba-bef2-4357-bf54-d9f1b268348e tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1554 microversion: 2.1 time: 0.458190 Nov 22 10:40:50.321388 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 491/993] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:49 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1554 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:40:50.364149 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-581e8ab4-cbc1-42d8-8ef3-7f8d34c3c3fd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 32119 microversion: 2.20 time: 0.144674 Nov 22 10:40:50.364936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 503/994] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:50 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 32119 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:40:51.155554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-dc9efbbf-3deb-49b3-b89c-200897630b64 req-b314850d-a9e5-47fd-8cf5-bb78e7dc0668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc98df96-7387-4b77-a13e-8f8bce4fba68", "name": "network-vif-deleted", "tag": "326eedf5-8a3e-4e3a-887c-a2d57a212dc8"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:51.157655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:51.157655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:51.166454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-dc9efbbf-3deb-49b3-b89c-200897630b64 req-b314850d-a9e5-47fd-8cf5-bb78e7dc0668 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.167198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-dc9efbbf-3deb-49b3-b89c-200897630b64 req-b314850d-a9e5-47fd-8cf5-bb78e7dc0668 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.180924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-dc9efbbf-3deb-49b3-b89c-200897630b64 req-b314850d-a9e5-47fd-8cf5-bb78e7dc0668 service nova] Creating event network-vif-deleted:326eedf5-8a3e-4e3a-887c-a2d57a212dc8 for instance cc98df96-7387-4b77-a13e-8f8bce4fba68 on hv-cinder-80403 Nov 22 10:40:51.187939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-dc9efbbf-3deb-49b3-b89c-200897630b64 req-b314850d-a9e5-47fd-8cf5-bb78e7dc0668 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036011 Nov 22 10:40:51.189030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 492/995] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:51.225394 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:51.228168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:51.237897 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.238747 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.239943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.240906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.335119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-91185d2e-50c2-40c9-af42-2018f130ce9f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28699 microversion: 2.1 time: 0.113860 Nov 22 10:40:51.339240 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 504/996] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:51 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28699 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:40:51.340003 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:51.342002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:51.349363 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.349840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.350628 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.351052 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.376696 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:51.377911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:51.382188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.382634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.383117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lazy-loading 'fault' on Instance uuid cc98df96-7387-4b77-a13e-8f8bce4fba68 {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:40:51.384958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.385407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.386193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.386685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.425657 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a31a4da645e9478f875389f7c70d27cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '549a9a424a794c74836d8d862db06e25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:40:51.433975 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ee596c6e-c064-4627-830b-205b6b36ef2c tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 200 len: 1348 microversion: 2.1 time: 0.099023 Nov 22 10:40:51.434580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 493/997] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:51 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:40:51.482709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e7345456-7e79-47e7-abf7-87931fc0f6e9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 33297 microversion: 2.20 time: 0.109853 Nov 22 10:40:51.483541 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 505/998] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:51 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 33297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:40:51.589040 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-81aeb5d3-0f45-48d4-b59b-e5858a65ccf0 req-7198a412-1001-4000-9c4a-8c46afbaca85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "name": "network-vif-plugged", "status": "completed", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:51.591157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:40:51.591157 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:40:51.600515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-81aeb5d3-0f45-48d4-b59b-e5858a65ccf0 req-7198a412-1001-4000-9c4a-8c46afbaca85 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:51.600829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-81aeb5d3-0f45-48d4-b59b-e5858a65ccf0 req-7198a412-1001-4000-9c4a-8c46afbaca85 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:51.615715 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-81aeb5d3-0f45-48d4-b59b-e5858a65ccf0 req-7198a412-1001-4000-9c4a-8c46afbaca85 service nova] Creating event network-vif-plugged:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:40:51.620914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-81aeb5d3-0f45-48d4-b59b-e5858a65ccf0 req-7198a412-1001-4000-9c4a-8c46afbaca85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037367 Nov 22 10:40:51.621724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 494/999] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:40:52.347883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:52.348889 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:52.356484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.356940 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.357739 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.358179 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.432212 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4bcc370e-0b5f-4339-8b73-84ceb71f0ca8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28699 microversion: 2.1 time: 0.088477 Nov 22 10:40:52.432865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 506/1000] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:52 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28699 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:52.453025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:52.453721 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] [instance: cc98df96-7387-4b77-a13e-8f8bce4fba68] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:52.460530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.460968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.461780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.462216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.476874 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] HTTP exception thrown: Instance cc98df96-7387-4b77-a13e-8f8bce4fba68 could not be found. Nov 22 10:40:52.477462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Returning 404 to user: Instance cc98df96-7387-4b77-a13e-8f8bce4fba68 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:40:52.478278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-441b7738-8f07-4db9-81cb-ca4b4cd86f23 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68" status: 404 len: 111 microversion: 2.1 time: 0.029984 Nov 22 10:40:52.478842 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 495/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:40:52 2021] GET /compute/v2.1/servers/cc98df96-7387-4b77-a13e-8f8bce4fba68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:40:52.488314 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-44c7362f-bac8-4101-98b9-59ec8b6bc6b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] Calling method '.version_select at 0x7f1a592f0a60>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:40:52.495352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:52.496322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:52.502811 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.503268 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.504143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:52.504568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:52.508988 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-44c7362f-bac8-4101-98b9-59ec8b6bc6b9 tempest-TestMinimumBasicScenario-392877170 tempest-TestMinimumBasicScenario-392877170-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-472014356" status: 202 len: 0 microversion: 2.1 time: 0.025137 Nov 22 10:40:52.509621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 507/1002] 10.222.0.46 () {58 vars in 1268 bytes} [Mon Nov 22 10:40:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-472014356 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:52.588097 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c02dce25-7adf-4b6a-9922-3a8f3473cd80 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 34001 microversion: 2.20 time: 0.096300 Nov 22 10:40:52.588755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 496/1003] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:52 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 34001 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:53.444814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:53.445891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:53.453492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:53.454038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:53.455558 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:53.456024 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:53.530336 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-93b2ad08-e594-4061-b069-603be5bacd01 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28699 microversion: 2.1 time: 0.089526 Nov 22 10:40:53.531286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 508/1004] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:53 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28699 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:53.601751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:53.602990 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:53.610559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:53.611332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:53.612330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:53.612815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:53.696792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-fa212d74-5c40-4eb0-9531-7d8eb025c877 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 35161 microversion: 2.20 time: 0.099056 Nov 22 10:40:53.697480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 497/1005] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:53 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 35161 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:54.543323 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:54.544395 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:54.551880 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:54.552343 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:54.553143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:54.553582 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:54.627177 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6a41f5a1-7f81-4ee4-a8db-9337a2c2af37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 28699 microversion: 2.1 time: 0.087445 Nov 22 10:40:54.628031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 509/1006] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:54 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 28699 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:54.710409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:54.711422 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:54.718523 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:54.719217 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:54.720290 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:54.720884 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:54.805064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b13e9142-3182-40f5-b8df-98cfbbb0eb13 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 36637 microversion: 2.20 time: 0.098527 Nov 22 10:40:54.805901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 498/1007] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:54 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 36637 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:40:55.648170 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:55.649846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:55.658455 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:55.658893 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:55.659711 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:55.660156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:55.767602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b47e2054-4f37-4da7-b45e-410ba062ef09 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 30273 microversion: 2.1 time: 0.130072 Nov 22 10:40:55.768355 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 510/1008] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:55 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 30273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:55.819525 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:55.820721 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:55.829014 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:55.830216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:55.831231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:55.831683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:55.923300 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3306721d-3260-45bb-a5ae-4ce6c64290b1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 38055 microversion: 2.20 time: 0.108337 Nov 22 10:40:55.924064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 499/1009] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:55 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 38055 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:56.780782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:56.781869 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:56.789190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:56.789617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:56.790409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:56.790848 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:56.872826 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1dfa65f1-4d84-4d05-b7b0-f07adfcea037 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 31816 microversion: 2.1 time: 0.096101 Nov 22 10:40:56.873500 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 511/1010] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:56 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 31816 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:56.936646 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:56.937706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:56.945070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:56.945517 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:56.946302 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:56.946734 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:57.021426 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7c1996fc-c541-45f0-b164-890172288f79 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 38214 microversion: 2.20 time: 0.088776 Nov 22 10:40:57.022092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 500/1011] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:56 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 38214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:57.885990 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:57.887110 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:57.894447 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:57.894890 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:57.895652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:57.896104 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:57.969968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-da3163dc-0758-452c-863c-c69e674beaa2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 33028 microversion: 2.1 time: 0.087820 Nov 22 10:40:57.970968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 512/1012] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:57 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 33028 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:58.034210 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:58.036549 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:58.043856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:58.044588 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:58.045700 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:58.046140 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:58.112478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5947a80d-5024-40bf-9f63-01717a8a447a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 38214 microversion: 2.20 time: 0.081476 Nov 22 10:40:58.112478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 501/1013] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:58 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 38214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:40:58.984932 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:58.985957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:58.993194 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:58.993650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:58.994462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:58.994896 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:59.068383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a0177ec2-a1b1-428d-b31d-6a84043ef578 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 34026 microversion: 2.1 time: 0.087423 Nov 22 10:40:59.069085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 513/1014] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:40:58 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 34026 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:40:59.124629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:40:59.125773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:40:59.133135 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:59.133574 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:59.134365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:40:59.134792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:40:59.202905 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-338a97c7-ed27-4e20-8ccd-0387dc1ae0de tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 38214 microversion: 2.20 time: 0.081978 Nov 22 10:40:59.203619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 502/1015] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:40:59 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 38214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:41:00.081377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:00.082385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:00.089685 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.090119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.090920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.091346 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.168188 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1ab1d38e-cec9-4fdf-88f5-1d9bef085b4e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 35450 microversion: 2.1 time: 0.090735 Nov 22 10:41:00.168884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 514/1016] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:00 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 35450 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:00.215555 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:00.216536 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:00.224046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.224495 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.225285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.225714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.303473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d7fa72f1-feb7-4aa6-9b43-d66fadf9a312 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 200 len: 38357 microversion: 2.20 time: 0.091922 Nov 22 10:41:00.304334 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 503/1017] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:41:00 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 38357 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:41:00.315477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:00.316080 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:00.323146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.323619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.324432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:00.324886 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:00.350147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4dce42a8-4b12-41a7-bd76-b50f694e2691 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/ips" status: 200 len: 150 microversion: 2.20 time: 0.039086 Nov 22 10:41:00.350741 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 515/1018] 10.222.0.46 () {60 vars in 1288 bytes} [Mon Nov 22 10:41:00 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:01.181435 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:01.182486 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:01.190110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:01.190548 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:01.191341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:01.191795 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:01.267815 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-458f2b99-301b-4172-a7ab-38872707cf7e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 36848 microversion: 2.1 time: 0.090272 Nov 22 10:41:01.268578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 504/1019] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:01 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 36848 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:02.280329 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:02.281249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:02.288444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.288853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.289689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.290132 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.369470 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-16b5d1d5-64b3-48c2-bb60-5bb415b75e7a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 38127 microversion: 2.1 time: 0.092706 Nov 22 10:41:02.370153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 516/1020] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:02 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 38127 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:02.414120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:02.414821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:02.422084 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.422599 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.423580 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.424044 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.448156 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lazy-loading 'flavor' on Instance uuid 2fc31878-b3c3-4d79-a38b-db8424acb20b {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:02.721837 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-650a2597-cd3f-41ae-abf5-9e1afdd9690a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 202 len: 0 microversion: 2.20 time: 0.311812 Nov 22 10:41:02.722487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 505/1021] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:41:02 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:41:02.731322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:02.732165 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:02.739814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.740267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.741082 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:02.741514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:02.920441 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:02.929286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:02.930906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:02.932135 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-c115f065-1a70-4413-bf4f-9f6267b435b2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.204994 Nov 22 10:41:02.932686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 517/1022] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:02 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:41:03.383128 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:03.384183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:03.390807 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:03.391640 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:03.392461 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:03.392906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:03.478564 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0a5f75a3-ed10-457b-b905-2195043d49ae tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 38233 microversion: 2.1 time: 0.099896 Nov 22 10:41:03.479376 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 506/1023] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:03 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 38233 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:03.951468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:03.952159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:03.959303 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:03.959857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:03.960659 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:03.961094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:04.097482 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:04.106135 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:04.107614 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:04.108847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-31201c53-6086-41f0-bb0f-ea81e01d1e0b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.161281 Nov 22 10:41:04.109420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 518/1024] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:03 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:04.493710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:04.494828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:04.503285 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:04.503777 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:04.504570 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:04.505003 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:04.570674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f85fb919-7625-4309-ab13-df947704732c tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 38233 microversion: 2.1 time: 0.082314 Nov 22 10:41:04.571366 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 507/1025] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:04 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 38233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:05.130005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:05.130962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:05.140827 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:05.141483 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:05.142554 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:05.143218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:05.282505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:05.290899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:05.292479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:05.293652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-80fbe0bc-4184-41bc-8735-c0de39d997fb tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.169657 Nov 22 10:41:05.294230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 519/1026] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:05 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:05.583373 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:05.584438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:05.591773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:05.592585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:05.593361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:05.593791 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:05.662365 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4c4ce79f-fc32-427e-a505-2a7a2b3fea18 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 38233 microversion: 2.1 time: 0.082973 Nov 22 10:41:05.663064 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 508/1027] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:05 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 38233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:06.311935 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:06.312584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:06.319411 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.319899 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.320691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.321125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.460969 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:06.472745 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:06.474292 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:06.475565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-36524d4b-b7ac-423d-aa81-5f03a86251f2 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.167498 Nov 22 10:41:06.476289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 520/1028] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:06 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:06.675519 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:06.676542 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:06.684650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.685419 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.686776 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.687506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.764122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-32361501-6b86-442e-a503-e77a66e1a47a tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action" status: 200 len: 38364 microversion: 2.1 time: 0.092880 Nov 22 10:41:06.764799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 509/1029] 10.222.0.46 () {60 vars in 1277 bytes} [Mon Nov 22 10:41:06 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/action => generated 38364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 10:41:06.775325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:06.775846 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:06.783079 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.783539 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.784364 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:06.784801 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:06.810004 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-66b57557-f3b3-4b84-9241-b62756edb8ec tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/ips" status: 200 len: 146 microversion: 2.1 time: 0.038479 Nov 22 10:41:06.810947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 521/1030] 10.222.0.46 () {58 vars in 1247 bytes} [Mon Nov 22 10:41:06 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:07.496488 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:07.497187 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:07.504424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:07.504869 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:07.505658 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:07.506093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:07.804295 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:07.813082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:07.814790 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:07.816006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f9df9181-b695-4c14-9368-a404e3520f03 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.323660 Nov 22 10:41:07.816568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 510/1031] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:07 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:08.129555 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cafe877-3024-4203-9ae1-c5c3d032850a"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:08.130670 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:08.137537 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:08.137989 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:08.138772 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:08.139206 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:08.393649 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-dc071e6e-de1d-476d-8a42-b2707dfc902f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268231 Nov 22 10:41:08.394290 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 522/1032] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:41:08 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:41:08.834960 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:08.835530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:08.842755 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:08.843216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:08.844192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:08.844626 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:08.985578 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:08.993665 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:08.995148 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:08.996349 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-872c5330-b81a-40bd-afbf-045b1f6e4b7a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.165240 Nov 22 10:41:08.996899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 511/1033] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:08 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:10.016013 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:10.017281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:10.024129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:10.024581 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:10.025380 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:10.025803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:10.164453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:10.176378 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:10.178162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:10.179342 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a13e597b-44f6-46d7-8dc2-3a4ef57bef4b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.168392 Nov 22 10:41:10.179956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 523/1034] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:10 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:11.198610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:11.199284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:11.206509 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:11.206959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:11.207770 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:11.208216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:11.354015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:11.363828 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:11.365654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:11.367322 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5a1ea95f-5518-4837-998c-9d583c41a2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.172356 Nov 22 10:41:11.367997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 512/1035] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:11 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:12.386781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:12.387423 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:12.394789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:12.395230 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:12.396048 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:12.396473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:12.533267 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:12.541791 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:12.543284 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:12.544494 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2ef63575-3ffa-4dbb-bd13-e805d3b00e8a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.161523 Nov 22 10:41:12.545074 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 524/1036] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:12 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:13.562911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:13.563917 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:13.570945 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:13.571405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:13.572281 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:13.572717 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:13.712850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:13.722029 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:13.723444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:13.724688 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3c4dd4cb-ef60-4fbc-ae86-dc7dca05824c tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1743 microversion: 2.20 time: 0.165855 Nov 22 10:41:13.725395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 513/1037] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:13 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:14.743647 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:14.744298 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:14.751360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:14.752154 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:14.752987 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:14.753617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:14.910764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:14.919390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:14.921098 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:14.922565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2a3fba34-10bb-49d9-b7a2-4fb83675b44f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1743 microversion: 2.20 time: 0.182737 Nov 22 10:41:14.923166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 525/1038] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:14 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:15.941605 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:15.943171 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:15.951705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:15.952760 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:15.953575 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:15.953828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:15.954864 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:15.955522 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:15.961325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:15.962207 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:15.963330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:15.964058 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:15.996780 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-002b90e3-4c18-4a00-8905-45774347c9c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 Nov 22 10:41:15.997774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 526/1039] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:41:15 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:41:16.007977 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:16.009028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:16.015764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:16.016802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:16.017884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:16.018535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:16.053496 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-978dedc8-87a7-442f-926a-4b2d5cf18db5 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a" status: 200 len: 194 microversion: 2.1 time: 0.049300 Nov 22 10:41:16.054689 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 527/1040] 10.222.0.46 () {58 vars in 1412 bytes} [Mon Nov 22 10:41:16 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:16.202451 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:16.212464 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:16.214378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:16.215845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-943e5e43-7958-40f3-8c9f-ade2fe241534 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.278353 Nov 22 10:41:16.238818 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 514/1041] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:15 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:17.248204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:17.252053 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:17.261504 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:17.262094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:17.262983 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:17.263420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:17.426985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:17.436273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:17.439287 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:17.440499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-029fb71f-304c-4a0c-946d-10f8d2ada148 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.198839 Nov 22 10:41:17.447393 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 528/1042] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:17 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:17.561270 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80713484-281e-42b9-a8d0-1246055c0de7"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:17.562442 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:17.569568 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:17.570103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:17.571048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:17.571255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:17.814397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-12de4c59-b591-498a-9cfa-7e20cac4781a req-7a1e9f7e-5897-4b34-bf53-7906363e0d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "name": "network-vif-plugged", "status": "completed", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:17.818273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:41:17.818273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:41:17.826146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-12de4c59-b591-498a-9cfa-7e20cac4781a req-7a1e9f7e-5897-4b34-bf53-7906363e0d5b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:17.827242 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-12de4c59-b591-498a-9cfa-7e20cac4781a req-7a1e9f7e-5897-4b34-bf53-7906363e0d5b service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:17.846672 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-12de4c59-b591-498a-9cfa-7e20cac4781a req-7a1e9f7e-5897-4b34-bf53-7906363e0d5b service nova] Creating event network-vif-plugged:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:41:17.854062 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-12de4c59-b591-498a-9cfa-7e20cac4781a req-7a1e9f7e-5897-4b34-bf53-7906363e0d5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043644 Nov 22 10:41:17.855043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 529/1043] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:17.973422 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9539f851-6ca6-469d-a9c3-93acb2debfbe tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417062 Nov 22 10:41:17.975261 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 515/1044] 10.222.0.46 () {60 vars in 1322 bytes} [Mon Nov 22 10:41:17 2021] POST /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 194 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:18.479904 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:18.480663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:18.488720 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:18.489246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:18.490134 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:18.490670 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:18.678271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:18.693377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:18.696369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:18.697861 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-35582541-8ccc-4715-8ec8-eaa7fdbdd421 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.233516 Nov 22 10:41:18.698491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 530/1045] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:18 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:19.721983 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:19.724487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:19.734192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:19.735225 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:19.736367 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:19.737308 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:20.008198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:20.019601 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:20.021309 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:20.022720 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1f6bf176-ff26-4879-b86f-b10224292909 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.308715 Nov 22 10:41:20.023400 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 516/1046] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:19 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:41:21.048114 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:21.050479 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:21.060714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:21.061383 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:21.062540 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:21.063083 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:21.263711 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:21.281397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:21.285535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:21.287279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-576a324e-80b0-4f8e-923a-4e17fdd4cab9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.246888 Nov 22 10:41:21.288337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 531/1047] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:21 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:22.314989 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:22.316659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:22.329305 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:22.330167 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:22.331625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:22.332498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:22.616455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:22.630913 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:22.633951 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:22.636118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8696d03b-5cd9-4cff-81cf-5a2cf71a6472 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.332023 Nov 22 10:41:22.637500 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 517/1048] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:22 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:23.658776 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:23.661102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:23.670028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:23.671799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:23.672877 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:23.673642 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:23.889924 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:23.907713 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:23.910828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:23.912906 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-464a90b7-8e73-4f01-abe0-846f7d876628 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.260940 Nov 22 10:41:23.914344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 532/1049] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:23 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:24.945610 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:24.950625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:24.976870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:24.977692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:24.979049 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:24.979781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:25.230598 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:25.240854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:25.241504 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:25.242709 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-4724a46f-a20c-447f-ac08-96705259367e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.304398 Nov 22 10:41:25.243835 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 518/1050] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:24 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:25.774639 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:25.775936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:25.783505 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:25.784126 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:25.785024 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:25.785551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:25.823296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cb047845-f75b-44cc-bf1c-5039aaf05669 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.055092 Nov 22 10:41:25.824039 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 533/1051] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:41:25 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:26.095636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:26.096312 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:26.103855 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.104344 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.105326 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.105802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.141332 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-195b822a-24fc-42e6-a451-34c971c3522e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a" status: 200 len: 194 microversion: 2.1 time: 0.049623 Nov 22 10:41:26.141965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 519/1052] 10.222.0.46 () {58 vars in 1412 bytes} [Mon Nov 22 10:41:26 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:26.152246 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:26.152903 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:26.160401 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.160961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.161884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.162407 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.256077 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'services' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:26.270685 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:26.271276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:26.279007 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.279445 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.280508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:26.281043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:26.338438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e3109354-d8fa-4416-aeeb-b98a654668aa tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a" status: 202 len: 0 microversion: 2.1 time: 0.189824 Nov 22 10:41:26.343485 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 534/1053] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:41:26 2021] DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/8cafe877-3024-4203-9ae1-c5c3d032850a => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:41:26.473417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:26.485675 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:26.487865 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:26.489318 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d4faea0a-a22b-4277-8b7d-69093312070b tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1738 microversion: 2.20 time: 0.222942 Nov 22 10:41:26.490002 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 520/1054] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:26 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:41:27.489785 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:27.490445 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:27.497409 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.497858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.498679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.499102 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.509754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:27.510348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:27.517360 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.517817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.518635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.519067 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.532925 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d02a94a9-d6fe-4035-a81b-9ffd51b3f43b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/80713484-281e-42b9-a8d0-1246055c0de7" status: 200 len: 194 microversion: 2.1 time: 0.048868 Nov 22 10:41:27.533527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 535/1055] 10.222.0.46 () {58 vars in 1412 bytes} [Mon Nov 22 10:41:27 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/80713484-281e-42b9-a8d0-1246055c0de7 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:27.543204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:27.543786 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:27.550706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.551161 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.552036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:27.552472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:27.648590 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'services' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:27.686714 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:27.695620 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:27.697158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:27.698395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5c4820d1-0732-4918-857f-1eefcf6a7867 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1720 microversion: 2.20 time: 0.192745 Nov 22 10:41:27.699284 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 521/1056] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:27 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:27.725829 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b8319051-a32f-4186-b652-446b438cbd1b tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/80713484-281e-42b9-a8d0-1246055c0de7" status: 202 len: 0 microversion: 2.1 time: 0.186110 Nov 22 10:41:27.726673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 536/1057] 10.222.0.46 () {58 vars in 1415 bytes} [Mon Nov 22 10:41:27 2021] DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments/80713484-281e-42b9-a8d0-1246055c0de7 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 10:41:28.718193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:28.719147 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:28.725586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.726043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.726890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.727280 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.879397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:28.888033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:28.889086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:28.889681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:28.890388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:28.891050 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2448ec98-d944-4667-a706-008985b36c65 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1723 microversion: 2.20 time: 0.177195 Nov 22 10:41:28.891630 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 522/1058] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:28 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:28.897019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.897476 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.898337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.898774 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.909147 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c1e1fc7-f881-449e-aa6e-bfc58c249bdd"}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:28.910225 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:28.916201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.916827 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.917447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:28.917880 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:28.930630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-fe05ac03-d9a0-4e12-8f19-88e56549c897 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045995 Nov 22 10:41:28.931272 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 537/1059] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:41:28 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 10:41:29.042804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:29.043736 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.050580 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.051416 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.053422 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.054135 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.086611 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8931c803-a3a6-46b9-9e03-6ad5c6c5584d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048023 Nov 22 10:41:29.087213 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 538/1060] 10.222.0.46 () {58 vars in 1301 bytes} [Mon Nov 22 10:41:29 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 10:41:29.154510 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:29.155390 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.166447 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.167241 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.168613 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.169362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.210439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:41:29.228744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1fa9b52c-9f8c-41a3-b402-41bbde3afd10 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.323275 Nov 22 10:41:29.234788 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 523/1061] 10.222.0.46 () {62 vars in 1363 bytes} [Mon Nov 22 10:41:28 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments => generated 188 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 10:41:29.295210 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b16955cf-0fcd-483f-9dad-5e937612cdcb tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 204 len: 0 microversion: 2.1 time: 0.147962 Nov 22 10:41:29.296203 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 539/1062] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:41:29 2021] DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:41:29.309789 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:29.310380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.320704 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.321152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.321916 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.322337 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.350236 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:29.350834 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.356817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.357266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.358049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.358481 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.463341 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:29.472508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ae5d7c8a-e9d8-4ecd-80ff-ae7f54bcee8d tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1673 microversion: 2.1 time: 0.169041 Nov 22 10:41:29.473102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 524/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:29 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:29.597636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b02d06c3-3166-4ec1-9148-7da0559740ed tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments/4c1e1fc7-f881-449e-aa6e-bfc58c249bdd" status: 202 len: 0 microversion: 2.20 time: 0.251456 Nov 22 10:41:29.598249 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 540/1064] 10.222.0.46 () {60 vars in 1456 bytes} [Mon Nov 22 10:41:29 2021] DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments/4c1e1fc7-f881-449e-aa6e-bfc58c249bdd => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 22 10:41:29.663001 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:29.663931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.675566 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.676389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.677841 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.678616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.762213 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-eb6a2012-a8fd-4306-b2ca-43bfaa5c5121 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action" status: 202 len: 0 microversion: 2.20 time: 0.106715 Nov 22 10:41:29.763577 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 525/1065] 10.222.0.46 () {62 vars in 1318 bytes} [Mon Nov 22 10:41:29 2021] POST /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:41:29.772435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:29.773056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:29.779121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.779576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.780431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:29.780959 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:29.953086 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:29.962119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:29.963683 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:29.964874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1ec2c4cf-7333-4a7e-bac7-5c23e91b380a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1671 microversion: 2.20 time: 0.196352 Nov 22 10:41:29.965442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 541/1066] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:29 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:30.493324 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:30.494558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:30.503281 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:30.504020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:30.504693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:30.505274 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:30.655242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:30.663995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-16cf1ecb-e504-4332-a230-1c029269b10e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1673 microversion: 2.1 time: 0.176418 Nov 22 10:41:30.664581 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 526/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:30 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:30.987357 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:30.988652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:30.999865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:31.000593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:31.002201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:31.002863 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:31.249302 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:31.258096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:31.259622 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:31.260839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b8519973-d74c-48d9-a42d-f5251b9959ca tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.280409 Nov 22 10:41:31.261397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 542/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:30 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:31.690540 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:31.691834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:31.698850 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:31.699480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:31.700432 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:31.700945 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:31.779527 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-1c69d2d1-d242-4907-a695-aebb34fdd3e1 req-792416db-800b-4b26-8e69-54734b65a8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "name": "network-vif-unplugged", "status": "completed", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:31.781875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:41:31.781875 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:41:31.790196 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-1c69d2d1-d242-4907-a695-aebb34fdd3e1 req-792416db-800b-4b26-8e69-54734b65a8a0 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:31.791752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-1c69d2d1-d242-4907-a695-aebb34fdd3e1 req-792416db-800b-4b26-8e69-54734b65a8a0 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:31.806168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-1c69d2d1-d242-4907-a695-aebb34fdd3e1 req-792416db-800b-4b26-8e69-54734b65a8a0 service nova] Creating event network-vif-unplugged:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:41:31.811492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-1c69d2d1-d242-4907-a695-aebb34fdd3e1 req-792416db-800b-4b26-8e69-54734b65a8a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035709 Nov 22 10:41:31.812455 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 543/1069] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:32.116686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:32.125767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-94119d66-a43f-450e-8056-0a90b3d62323 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1673 microversion: 2.1 time: 0.438965 Nov 22 10:41:32.126425 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 527/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:31 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1673 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:32.282004 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:32.283333 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:32.290995 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:32.291545 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:32.292440 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:32.292995 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:32.659081 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:32.671438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:32.673389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:32.674778 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-7f58d632-4060-430f-a541-02ac84880e41 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.397508 Nov 22 10:41:32.675344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 544/1071] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:32 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:32.834462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-80900713-0a49-4b2a-a93c-b9625d6dbc60 req-4ee9dfd8-d552-4c6d-acdb-db0e5fc8e5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d047109-27a0-4543-b6eb-090c24da838c", "name": "network-vif-deleted", "tag": "1f9f89bb-4d09-4294-befd-5f60447d46a9"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:32.836673 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:41:32.836673 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:41:32.850298 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-80900713-0a49-4b2a-a93c-b9625d6dbc60 req-4ee9dfd8-d552-4c6d-acdb-db0e5fc8e5c7 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:32.850681 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-80900713-0a49-4b2a-a93c-b9625d6dbc60 req-4ee9dfd8-d552-4c6d-acdb-db0e5fc8e5c7 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:32.867183 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-80900713-0a49-4b2a-a93c-b9625d6dbc60 req-4ee9dfd8-d552-4c6d-acdb-db0e5fc8e5c7 service nova] Creating event network-vif-deleted:1f9f89bb-4d09-4294-befd-5f60447d46a9 for instance 3d047109-27a0-4543-b6eb-090c24da838c on hv-cinder-80403 Nov 22 10:41:32.872911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-80900713-0a49-4b2a-a93c-b9625d6dbc60 req-4ee9dfd8-d552-4c6d-acdb-db0e5fc8e5c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044511 Nov 22 10:41:32.873914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 528/1072] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:41:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:41:33.144220 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:33.145085 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:33.157104 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:33.157888 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:33.159649 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:33.162438 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:33.209697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:33.210539 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:33.211261 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:33.293025 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:33.302804 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-acbad6b9-83b2-4d66-8478-8c3c4398fa34 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.163153 Nov 22 10:41:33.314480 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 545/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:33 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:33.695124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:33.696405 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:33.703483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:33.704236 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:33.705059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:33.706043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:33.926881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:33.937372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:33.939371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:33.941165 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3cf306c5-3d41-4610-a568-4a4d0748f0cd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.250426 Nov 22 10:41:33.951780 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 529/1074] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:33 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:34.322456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:34.323187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:34.330228 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:34.330954 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:34.331957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:34.332553 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:34.365369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:34.365821 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:34.366277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:34.428807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:34.438446 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d2ea1240-1c19-445d-b033-e5f5eec9124f tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.119874 Nov 22 10:41:34.439081 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 546/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:34 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:41:34.960193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:34.960899 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:34.970043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:34.970870 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:34.972099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:34.972825 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:35.129687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:35.138881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:35.140476 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:35.141729 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5b06ca48-9fa1-4a16-8327-2796b9d84cfd tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.185389 Nov 22 10:41:35.142321 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 530/1076] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:34 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:35.456138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:35.456757 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:35.463923 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:35.464372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:35.465145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:35.465592 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:35.497771 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:35.498224 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:35.498650 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:35.541243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:35.549600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-705ce4f9-08c4-402e-a1dd-4da47e14b890 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.097480 Nov 22 10:41:35.550225 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 547/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:35 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:36.161481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:36.163299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:36.171167 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:36.172030 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:36.173891 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:36.174590 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:36.319059 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:36.328427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:36.330208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:36.331406 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f9d6e66c-ad54-4461-b413-39e91176c2f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.174476 Nov 22 10:41:36.332020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 531/1078] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:36 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:36.567180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:36.568495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:36.575275 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:36.576008 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:36.576998 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:36.577594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:36.616948 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:36.617392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:36.617844 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:36.657799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:36.665321 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bc76ecdb-4e79-4027-800c-c7e7623a2da1 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.102556 Nov 22 10:41:36.665963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 548/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:36 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:37.350731 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:37.351314 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:37.359017 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:37.359737 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:37.360642 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:37.361076 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:37.509765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:37.517676 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:37.519170 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:37.520353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c7480109-ef18-4e53-b145-e9f4386580d3 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.173644 Nov 22 10:41:37.520949 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 532/1080] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:37 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:37.682525 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:37.683124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:37.695064 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:37.695523 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:37.696360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:37.696797 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:37.730641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:37.731071 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:37.731526 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:37.778593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:37.788119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-9257050a-766d-48e0-9ecf-07f3c5a5ebd2 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.109099 Nov 22 10:41:37.789791 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 549/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:37 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:38.539567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:38.540978 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:38.552914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:38.553299 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:38.554099 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:38.563521 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:38.729958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:38.739228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:38.741228 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:38.753172 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3e4a77ce-6eb1-41e0-bba5-24a4a2bc322e tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.217652 Nov 22 10:41:38.754126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 533/1082] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:38 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:41:38.806340 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:38.806952 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:38.817020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:38.817484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:38.818286 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:38.818702 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:38.854300 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:38.854817 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:38.855296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:38.906344 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:38.921887 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-54bcc4ff-9d9c-4783-b0de-f685976cade9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.118689 Nov 22 10:41:38.923895 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 550/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:38 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:39.772087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:39.772695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:39.780126 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:39.780671 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:39.781481 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:39.781908 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:39.935201 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:39.939016 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:39.939630 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:39.943595 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:39.945100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:39.946076 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:39.946266 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-17379ad4-599e-449d-a08f-d0ed9f412e42 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.178251 Nov 22 10:41:39.946529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:39.946863 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 534/1084] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:39 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:39.947420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:39.947949 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:39.980139 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:39.980576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:39.981033 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:40.021511 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:40.029995 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-de222342-9ad9-4baa-a922-5d273bfdd748 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.094687 Nov 22 10:41:40.031493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 551/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:39 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:40.969450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:40.981012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:41.005207 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:41.006860 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:41.008243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:41.009006 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:41.050808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:41.052254 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:41.058618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:41.059432 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:41.060460 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:41.061105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:41.095397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:41.095961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:41.096406 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:41.143113 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:41.151119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8b621829-22c4-4ebb-b906-0d21e9b37f37 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.106005 Nov 22 10:41:41.151745 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 552/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:41 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:41:41.219009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:41.228808 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:41.230508 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:41.231839 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-22c7e1f1-6c7c-4590-94c0-48221dd3fd84 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.269549 Nov 22 10:41:41.232412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 535/1087] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:40 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:42.168920 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:42.169631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:42.176444 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:42.176894 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:42.177684 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:42.178123 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:42.211159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:42.211594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:42.212065 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:42.250939 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:42.251726 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:42.258327 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:42.258804 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:42.259548 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:42.259720 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:42.260055 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:42.267547 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-1869d0f7-1642-4258-b222-62e661dc12c9 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.102309 Nov 22 10:41:42.268473 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 553/1088] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:42 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:42.401458 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:42.410490 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:42.412025 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:42.413200 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5f1c9e74-d426-4e4c-9110-6efe498fcbf4 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.166636 Nov 22 10:41:42.413773 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 536/1089] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:42 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:43.285944 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:43.286673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:43.293753 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:43.294205 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:43.294974 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:43.295612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:43.340387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:43.341181 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:43.341663 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:43.391962 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:43.400250 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-47fe6f18-5d4e-4d89-8939-fdf552047997 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.118267 Nov 22 10:41:43.400873 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 554/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:43 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:43.432427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:43.433124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:43.440666 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:43.441114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:43.441931 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:43.442359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:43.592977 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:43.601361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:43.602902 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:43.604169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-50017535-04aa-4d65-9cc3-3c98fc1ce7d9 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.175917 Nov 22 10:41:43.604761 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 537/1091] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:43 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:44.418628 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:44.419389 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:44.426155 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:44.426612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:44.427435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:44.427917 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:44.466239 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:44.466677 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:44.467493 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lazy-loading 'fault' on Instance uuid 3d047109-27a0-4543-b6eb-090c24da838c {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:41:44.508724 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c802b5b33724e6aa81889a01725ef02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3b1b45ca144f90b1c89acf24e22074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:44.515807 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6ed9a859-dc40-45df-98b9-d918d7c4b54e tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 200 len: 1327 microversion: 2.1 time: 0.101180 Nov 22 10:41:44.516386 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 555/1092] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:44 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:41:44.623401 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:44.624145 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:44.630654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:44.631111 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:44.631959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:44.632379 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:44.768666 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:44.776769 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:44.778245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:44.779409 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6b7f509f-abd8-488e-bec3-954468979bb8 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.160613 Nov 22 10:41:44.780194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 538/1093] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:44 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:45.534003 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:45.534627 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:45.541514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:45.541976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:45.542790 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:45.543226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:45.559162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. Nov 22 10:41:45.559820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:41:45.560675 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e0e0d41f-b89a-48d3-8012-cd4625b70296 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 404 len: 111 microversion: 2.1 time: 0.030772 Nov 22 10:41:45.561468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 556/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:45 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:41:45.570433 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-238f61b1-6371-4eac-9a1c-76191592efa3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '.version_select at 0x7f1a592c8160>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:45.593767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-238f61b1-6371-4eac-9a1c-76191592efa3 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-278541652" status: 202 len: 0 microversion: 2.1 time: 0.027159 Nov 22 10:41:45.594402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 539/1095] 10.222.0.46 () {58 vars in 1217 bytes} [Mon Nov 22 10:41:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-278541652 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:41:45.799322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:45.800002 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:45.807717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:45.808273 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:45.809763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:45.810339 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:45.971594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:45.981400 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:45.983006 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:45.984816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ba9dd160-8508-4a45-a351-74ff7629b623 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1729 microversion: 2.20 time: 0.190145 Nov 22 10:41:45.985442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 557/1096] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:45 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:47.005019 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:47.005607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:47.012358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:47.012845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:47.013639 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:47.014088 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:47.152395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:47.161184 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:47.162710 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:41:47.163947 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-7f95d444-bebb-4c48-80a1-0887a5fb9e0f tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1716 microversion: 2.20 time: 0.163586 Nov 22 10:41:47.164507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 540/1097] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:41:46 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:41:48.621439 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:48.622046 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:48.629097 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:48.629569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:48.630392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:48.630839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:48.647520 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. Nov 22 10:41:48.648105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:41:48.648983 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-4da31ff1-e7e4-4dc8-8173-1688cd685015 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 404 len: 111 microversion: 2.1 time: 0.031502 Nov 22 10:41:48.649543 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 558/1098] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:41:48 2021] DELETE /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:41:48.658075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:48.658708 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 3d047109-27a0-4543-b6eb-090c24da838c] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:48.665530 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:48.665976 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:48.666777 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:48.667206 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:48.681973 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. Nov 22 10:41:48.682586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 3d047109-27a0-4543-b6eb-090c24da838c could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:41:48.683452 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-432b0460-c732-48a5-bdd2-840923dbaf80 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c" status: 404 len: 111 microversion: 2.1 time: 0.029283 Nov 22 10:41:48.684093 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 541/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:48 2021] GET /compute/v2.1/servers/3d047109-27a0-4543-b6eb-090c24da838c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:41:49.829800 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:49.830361 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:49.837001 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:49.837453 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:49.838252 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:49.838682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:49.857819 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. Nov 22 10:41:49.859034 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:41:49.860055 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a0c3ea3c-797e-4949-bb79-60856336d3d8 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 404 len: 111 microversion: 2.1 time: 0.034753 Nov 22 10:41:49.860735 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 559/1100] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:41:49 2021] DELETE /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:41:49.869262 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:41:49.869911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] [instance: 516b0499-a733-410c-9a0c-6e98ff43aba0] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:41:49.877250 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:49.877915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:49.878840 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:49.879189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:49.893668 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] HTTP exception thrown: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. Nov 22 10:41:49.894260 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] Returning 404 to user: Instance 516b0499-a733-410c-9a0c-6e98ff43aba0 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:41:49.895086 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-07a3f9a9-3a87-4552-9499-b4bb6d20a779 tempest-AttachVolumeTestJSON-1178964364 tempest-AttachVolumeTestJSON-1178964364-project] 10.222.0.46 "GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0" status: 404 len: 111 microversion: 2.1 time: 0.030149 Nov 22 10:41:49.895645 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 542/1101] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:41:49 2021] GET /compute/v2.1/servers/516b0499-a733-410c-9a0c-6e98ff43aba0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:41:50.005955 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-cc9405ff-e608-4f2d-9ea6-4d79c48f395e req-8090ea02-e20d-499d-b760-7894f2f39f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "name": "network-vif-plugged", "status": "completed", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:41:50.007535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:41:50.007535 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:41:50.036138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-cc9405ff-e608-4f2d-9ea6-4d79c48f395e req-8090ea02-e20d-499d-b760-7894f2f39f8e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:41:50.037397 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-cc9405ff-e608-4f2d-9ea6-4d79c48f395e req-8090ea02-e20d-499d-b760-7894f2f39f8e service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:41:50.053693 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-cc9405ff-e608-4f2d-9ea6-4d79c48f395e req-8090ea02-e20d-499d-b760-7894f2f39f8e service nova] Creating event network-vif-plugged:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:41:50.059941 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-cc9405ff-e608-4f2d-9ea6-4d79c48f395e req-8090ea02-e20d-499d-b760-7894f2f39f8e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060169 Nov 22 10:41:50.061019 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 560/1102] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:41:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 10:42:06.676730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:06.677253 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:06.680005 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-9f82cc23-d22d-4397-829c-6d7b26a65d49 req-1847b099-8168-46a4-8c47-e71251261876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:42:06.682816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:42:06.682816 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:42:06.684237 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:06.684779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:06.685817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:06.686753 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:06.693026 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-9f82cc23-d22d-4397-829c-6d7b26a65d49 req-1847b099-8168-46a4-8c47-e71251261876 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:06.693815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-9f82cc23-d22d-4397-829c-6d7b26a65d49 req-1847b099-8168-46a4-8c47-e71251261876 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:06.706921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-9f82cc23-d22d-4397-829c-6d7b26a65d49 req-1847b099-8168-46a4-8c47-e71251261876 service nova] Creating event network-changed:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:42:06.715148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-9f82cc23-d22d-4397-829c-6d7b26a65d49 req-1847b099-8168-46a4-8c47-e71251261876 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037458 Nov 22 10:42:06.715148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 561/1103] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:42:06.725393 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:42:06.836740 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8f639ba6-0344-49b7-ab9b-b7cff4aeebb8 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 204 len: 0 microversion: 2.1 time: 0.163107 Nov 22 10:42:06.837797 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 543/1104] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:42:06 2021] DELETE /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:42:06.851891 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:06.852854 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:06.863697 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:06.864152 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:06.864998 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:06.865435 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:07.095431 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:07.103882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-543d762c-2ca7-4d58-aa0e-dd06f4357832 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1568 microversion: 2.1 time: 0.259784 Nov 22 10:42:07.104858 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 562/1105] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:06 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:42:08.122613 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:08.123417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:08.129984 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:08.130663 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:08.131202 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:08.131683 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:08.286263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:08.294487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-dd086bc2-1495-4fa4-96e2-75e6d43d0937 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1449 microversion: 2.1 time: 0.175887 Nov 22 10:42:08.295232 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 544/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:08 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1449 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:42:09.064330 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-70d5c056-8189-4c68-8660-ec77f96be463 req-ef32a334-e2da-410b-981c-7b2288a192e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79ad0cd-bef2-49ee-92cb-c20e41b3cedf", "name": "network-vif-deleted", "tag": "5a918824-cebb-4510-aebc-018e2f7e10b1"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:42:09.066569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:42:09.066569 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:42:09.074523 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-70d5c056-8189-4c68-8660-ec77f96be463 req-ef32a334-e2da-410b-981c-7b2288a192e8 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:09.074976 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-70d5c056-8189-4c68-8660-ec77f96be463 req-ef32a334-e2da-410b-981c-7b2288a192e8 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:09.087326 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-70d5c056-8189-4c68-8660-ec77f96be463 req-ef32a334-e2da-410b-981c-7b2288a192e8 service nova] Creating event network-vif-deleted:5a918824-cebb-4510-aebc-018e2f7e10b1 for instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf on hv-cinder-80403 Nov 22 10:42:09.092985 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-70d5c056-8189-4c68-8660-ec77f96be463 req-ef32a334-e2da-410b-981c-7b2288a192e8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032680 Nov 22 10:42:09.093681 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 563/1107] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:42:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:42:09.314380 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:09.314901 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:09.321103 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:09.321792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:09.322589 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:09.323020 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:09.401257 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13f1a43025414b4098ee39db391d525b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e14154c62a42a8b78c798e97aa89fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:09.411940 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3b3f3902-6e12-431b-bfa4-53e5519ce47b tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 200 len: 1219 microversion: 2.1 time: 0.101621 Nov 22 10:42:09.412819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 545/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:09 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:42:10.430761 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:10.431462 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] [instance: f79ad0cd-bef2-49ee-92cb-c20e41b3cedf] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:10.440258 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:10.440957 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:10.442279 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:10.442963 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:10.463762 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] HTTP exception thrown: Instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf could not be found. Nov 22 10:42:10.464442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Returning 404 to user: Instance f79ad0cd-bef2-49ee-92cb-c20e41b3cedf could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:10.466066 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3734fac7-81de-436e-b0eb-3c7446bd5b39 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf" status: 404 len: 111 microversion: 2.1 time: 0.039770 Nov 22 10:42:10.467108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 564/1109] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:10 2021] GET /compute/v2.1/servers/f79ad0cd-bef2-49ee-92cb-c20e41b3cedf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:42:10.636154 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f95dfd4c-d037-458e-996e-89ac14ab72a4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] Calling method '.version_select at 0x7f1a592b4700>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:10.663554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f95dfd4c-d037-458e-996e-89ac14ab72a4 tempest-TestShelveInstance-1612561918 tempest-TestShelveInstance-1612561918-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1099595075" status: 202 len: 0 microversion: 2.1 time: 0.031276 Nov 22 10:42:10.664485 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 546/1110] 10.222.0.46 () {58 vars in 1253 bytes} [Mon Nov 22 10:42:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1099595075 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:42:20.134175 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:20.137362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:20.147241 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.148305 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.149601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.150332 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.204600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-ba7ff1de-0d7a-4602-a1e6-b7b7e78e3153 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075988 Nov 22 10:42:20.205516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 565/1111] 10.222.0.46 () {60 vars in 1342 bytes} [Mon Nov 22 10:42:20 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:42:20.299386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:20.300271 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:20.312697 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.313482 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.315231 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.316068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.354153 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:42:20.537830 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-e69ee681-d7ec-4a04-8ddc-d89dcb2ab708 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 204 len: 0 microversion: 2.20 time: 0.241414 Nov 22 10:42:20.540986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 547/1112] 10.222.0.46 () {60 vars in 1279 bytes} [Mon Nov 22 10:42:20 2021] DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:42:20.556456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:20.557103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:20.564197 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.564694 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.565712 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:20.566184 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:20.932837 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:20.943601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:20.945516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:20.947045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-64d14edb-0f5c-40f2-bb32-89b8305b85f1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.396441 Nov 22 10:42:20.951717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 566/1113] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:42:20 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:42:21.969702 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:21.970845 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:21.979792 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:21.980245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:21.981378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:21.982320 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:22.296348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:22.307063 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:22.309249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:22.311692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f5716d82-09ee-4c3a-aa90-0357c82f36f0 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1722 microversion: 2.20 time: 0.347581 Nov 22 10:42:22.312454 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 548/1114] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:42:21 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 10:42:23.163116 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-bc4c3bf9-120c-4dcf-b54d-6d944d04f484 req-bd4dee6e-10e4-4e39-bf3d-cd909ae03d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc31878-b3c3-4d79-a38b-db8424acb20b", "name": "network-vif-deleted", "tag": "c090109f-0e04-44ab-9893-ad1a3bcccd12"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:42:23.166277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:42:23.166277 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:42:23.197714 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-bc4c3bf9-120c-4dcf-b54d-6d944d04f484 req-bd4dee6e-10e4-4e39-bf3d-cd909ae03d0a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:23.198584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-bc4c3bf9-120c-4dcf-b54d-6d944d04f484 req-bd4dee6e-10e4-4e39-bf3d-cd909ae03d0a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:23.240551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-bc4c3bf9-120c-4dcf-b54d-6d944d04f484 req-bd4dee6e-10e4-4e39-bf3d-cd909ae03d0a service nova] Creating event network-vif-deleted:c090109f-0e04-44ab-9893-ad1a3bcccd12 for instance 2fc31878-b3c3-4d79-a38b-db8424acb20b on hv-cinder-80403 Nov 22 10:42:23.250160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-bc4c3bf9-120c-4dcf-b54d-6d944d04f484 req-bd4dee6e-10e4-4e39-bf3d-cd909ae03d0a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098610 Nov 22 10:42:23.252222 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 567/1115] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:42:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:42:23.340754 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:23.341703 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:23.356155 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:23.360389 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:23.362668 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:23.364186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:23.452417 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:23.453158 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:23.453950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.objects.instance [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lazy-loading 'fault' on Instance uuid 2fc31878-b3c3-4d79-a38b-db8424acb20b {{(pid=122857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:42:23.520262 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:23.530711 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:23.533329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6b3fe28f16a45ff8b476fd2de4d557b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a799df19ef409eb8975d5f05fa1c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:42:23.535550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ea58824b-77be-4e0f-aa83-aab2079d66e7 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 200 len: 1372 microversion: 2.20 time: 0.199657 Nov 22 10:42:23.536437 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 549/1116] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:42:23 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 10:42:24.562760 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:24.563427 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:24.570263 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:24.570717 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:24.571516 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:24.571994 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:24.586874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. Nov 22 10:42:24.587477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:24.588349 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-34d48dba-e7f3-4e92-ab7f-317b2297857a tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 404 len: 111 microversion: 2.20 time: 0.030891 Nov 22 10:42:24.588930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 568/1117] 10.222.0.46 () {60 vars in 1276 bytes} [Mon Nov 22 10:42:24 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 10:42:24.598375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-8e30aa18-9b05-4d48-b54e-17c937c1ff11 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '.version_select at 0x7f1a59323430>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:24.620375 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-8e30aa18-9b05-4d48-b54e-17c937c1ff11 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883177468" status: 204 len: 0 microversion: 2.20 time: 0.025705 Nov 22 10:42:24.621956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 550/1118] 10.222.0.46 () {60 vars in 1261 bytes} [Mon Nov 22 10:42:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883177468 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 10:42:28.727506 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:28.728124 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:28.735121 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:28.735577 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:28.736420 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:28.736851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:28.750591 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. Nov 22 10:42:28.751195 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:28.752067 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-48ca085f-a740-43d2-8556-d7ef980dd5cc tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 404 len: 111 microversion: 2.1 time: 0.028377 Nov 22 10:42:28.752602 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 569/1119] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:42:28 2021] DELETE /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:42:28.761330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:28.761938 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 2fc31878-b3c3-4d79-a38b-db8424acb20b] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:28.768408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:28.768860 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:28.769640 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:28.770075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:28.784075 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. Nov 22 10:42:28.784671 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 2fc31878-b3c3-4d79-a38b-db8424acb20b could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:28.785499 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-16ab8004-0615-457a-b8b3-8eb2116d6bd1 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b" status: 404 len: 111 microversion: 2.1 time: 0.028535 Nov 22 10:42:28.786066 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 551/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:28 2021] GET /compute/v2.1/servers/2fc31878-b3c3-4d79-a38b-db8424acb20b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:42:30.092665 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:30.093566 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:30.099996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:30.100413 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:30.101221 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:30.101646 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:30.115929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. Nov 22 10:42:30.116559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:30.117392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8e91259f-9b7f-4e3f-a3f9-c41f7535ef93 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 404 len: 111 microversion: 2.1 time: 0.030915 Nov 22 10:42:30.117996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 570/1121] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:42:30 2021] DELETE /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:42:30.126494 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:42:30.127134 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] [instance: 640f234a-3202-4c2c-97b9-32b4048c9ef3] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:42:30.134249 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:30.134698 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:30.135528 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:42:30.136018 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:42:30.155705 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] HTTP exception thrown: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. Nov 22 10:42:30.156352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] Returning 404 to user: Instance 640f234a-3202-4c2c-97b9-32b4048c9ef3 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:42:30.157192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cc5077a5-c8e8-4416-9be0-40ebe479c323 tempest-AttachVolumeShelveTestJSON-1230407260 tempest-AttachVolumeShelveTestJSON-1230407260-project] 10.222.0.46 "GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3" status: 404 len: 111 microversion: 2.1 time: 0.034679 Nov 22 10:42:30.157751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 552/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:42:30 2021] GET /compute/v2.1/servers/640f234a-3202-4c2c-97b9-32b4048c9ef3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:42:44.066910 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Action: 'create', calling method: .version_select at 0x7f1a593639d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2102537703"}} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:42:44.088240 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:42:44.101883 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for user 026e7d57d6e04ae4bac425987a641b94 and project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:42:44.390808 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:42:44.396231 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.quota [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for user 026e7d57d6e04ae4bac425987a641b94 and project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'key_pairs'} {{(pid=122858) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:42:44.412522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f96a6bc7-d2b5-476d-8b2e-75fdff6046c2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.543608 Nov 22 10:42:44.413136 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 571/1123] 10.222.0.46 () {60 vars in 1157 bytes} [Mon Nov 22 10:42:43 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:08.245548 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-296885510", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102537703", "security_groups": [{"name": "tempest-secgroup-smoke-1365048420"}], "block_device_mapping_v2": [{"uuid": "d4a9ef75-f26a-4c94-a713-cbce7f7211eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7304a1e-1535-4fd7-8c3b-2de67fef34b2"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:43:08.402651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] validate_networks() for [('f7304a1e-1535-4fd7-8c3b-2de67fef34b2', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:43:09.021532 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:43:09.021959 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:43:09.022424 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:43:09.022802 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:43:09.023238 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:43:09.032723 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:09.033170 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:09.033993 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:09.034408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:09.052152 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:43:09.056427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for user 026e7d57d6e04ae4bac425987a641b94 and project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:43:09.117218 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:43:09.119512 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4a9ef75-f26a-4c94-a713-cbce7f7211eb',volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:43:09.266215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b3c11e58-8498-4976-81c4-06c357c031d6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.023861 Nov 22 10:43:09.267558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 553/1124] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:43:08 2021] POST /compute/v2.1/servers => generated 406 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:43:09.282565 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-89fc69e0-b003-4714-9760-60ea7fa73cbf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:09.283617 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-89fc69e0-b003-4714-9760-60ea7fa73cbf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:09.343991 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-89fc69e0-b003-4714-9760-60ea7fa73cbf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:09.352201 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-89fc69e0-b003-4714-9760-60ea7fa73cbf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1094 microversion: 2.1 time: 0.076789 Nov 22 10:43:09.352992 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 572/1125] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:09 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:10.370263 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3fd03ecc-d4fb-4a56-9a6f-634082b85e3f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:10.370945 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3fd03ecc-d4fb-4a56-9a6f-634082b85e3f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:10.432627 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3fd03ecc-d4fb-4a56-9a6f-634082b85e3f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:10.444215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3fd03ecc-d4fb-4a56-9a6f-634082b85e3f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1094 microversion: 2.1 time: 0.077288 Nov 22 10:43:10.445336 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 554/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:10 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:11.463318 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-b227b3e9-c455-4f4c-80bb-73b33381cc69 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:11.465456 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-b227b3e9-c455-4f4c-80bb-73b33381cc69 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:11.524374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-b227b3e9-c455-4f4c-80bb-73b33381cc69 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:11.531233 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-b227b3e9-c455-4f4c-80bb-73b33381cc69 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1094 microversion: 2.1 time: 0.072254 Nov 22 10:43:11.531936 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 573/1127] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:11 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:12.549741 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-6ccd3330-d2c2-4ec1-a72e-4acca8a18de9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:12.550316 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-6ccd3330-d2c2-4ec1-a72e-4acca8a18de9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:12.605478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-6ccd3330-d2c2-4ec1-a72e-4acca8a18de9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:12.614572 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-6ccd3330-d2c2-4ec1-a72e-4acca8a18de9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1094 microversion: 2.1 time: 0.068736 Nov 22 10:43:12.615177 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 555/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:12 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:13.637291 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:13.638592 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:13.650461 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:13.651266 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:13.652769 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:13.653529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:13.718796 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:13.726953 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-65e708d4-3d8c-434e-9d8d-7997ab662aeb tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1144 microversion: 2.1 time: 0.096730 Nov 22 10:43:13.727477 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 574/1129] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:13 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:14.750473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:14.751820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:14.759782 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:14.760240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:14.761046 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:14.761506 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:14.839288 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:14.848193 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-b9b86735-be4f-4727-847f-b5d37f1514ad tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1210 microversion: 2.1 time: 0.101864 Nov 22 10:43:14.848951 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 556/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:14 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:15.880081 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:15.881880 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:15.897850 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:15.898572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:15.900070 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:15.900703 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:16.108854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-f5a0a4d1-6731-4698-9040-a4ab68af5615 req-ee5cc443-2704-42c9-a5e4-40327359b4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20b54d-e29d-44d4-80db-b447ceac81c5", "tag": "e3101a59-2cca-4f49-b78e-c91a28401eb9"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:43:16.110559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:43:16.110559 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:43:16.134129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f5a0a4d1-6731-4698-9040-a4ab68af5615 req-ee5cc443-2704-42c9-a5e4-40327359b4ca service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:16.134980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f5a0a4d1-6731-4698-9040-a4ab68af5615 req-ee5cc443-2704-42c9-a5e4-40327359b4ca service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:16.156848 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-f5a0a4d1-6731-4698-9040-a4ab68af5615 req-ee5cc443-2704-42c9-a5e4-40327359b4ca service nova] Creating event network-changed:e3101a59-2cca-4f49-b78e-c91a28401eb9 for instance af20b54d-e29d-44d4-80db-b447ceac81c5 on hv-cinder-80403 Nov 22 10:43:16.162567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-f5a0a4d1-6731-4698-9040-a4ab68af5615 req-ee5cc443-2704-42c9-a5e4-40327359b4ca service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059462 Nov 22 10:43:16.163512 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 557/1131] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:43:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:43:16.171939 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:16.202743 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cc20e9e6-8274-4449-85de-e0353b52f157 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.329896 Nov 22 10:43:16.204600 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 575/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:15 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:17.222294 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:17.222997 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:17.229967 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:17.231504 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:17.231504 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:17.231834 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:17.493429 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:17.505567 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-5c749eaa-7855-43e5-b414-40af6f5a1814 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.287494 Nov 22 10:43:17.506972 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 558/1133] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:17 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:43:18.524679 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:18.525686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:18.535968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:18.536725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:18.538049 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:18.538799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:18.719150 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:18.727190 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e4935614-7638-46cc-ba6a-40827e998113 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.207035 Nov 22 10:43:18.727791 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 576/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:18 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:19.744358 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:19.744962 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:19.752484 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:19.753227 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:19.754243 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:19.754682 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:19.913447 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:19.921529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-78d2780c-6922-4b24-8a11-e920daa0e9bd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.181178 Nov 22 10:43:19.922188 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 559/1135] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:19 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:20.939040 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:20.939782 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:20.947574 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:20.949603 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:20.950781 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:20.951469 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:21.134618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:21.145849 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-529d8fbc-336b-44bd-afe9-19f68bec2d04 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.210536 Nov 22 10:43:21.146457 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 577/1136] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:20 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:43:22.169625 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:22.170427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:22.177730 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:22.178206 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:22.178993 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:22.179427 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:22.345288 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:22.358843 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c524a396-e33f-4cc5-83c1-4f5c235d45c6 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.193181 Nov 22 10:43:22.359706 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 560/1137] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:22 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:23.379836 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:23.380690 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:23.388428 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:23.388874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:23.389662 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:23.390093 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:23.434160 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:43:23.434425 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:43:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 (ip 10.222.0.46) !!! Nov 22 10:43:23.533709 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:23.542605 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-11e1b13d-9d98-4a77-817d-7d74be1f3d2e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.166426 Nov 22 10:43:23.543212 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 578/1138] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:23 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:24.566783 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:24.567441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:24.574550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:24.575005 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:24.575819 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:24.576252 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:24.721242 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:24.729361 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-150225c4-e528-494d-92e0-1a567db45384 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.166591 Nov 22 10:43:24.729982 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 561/1139] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:24 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:25.175384 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-c6c17ec1-7b25-46f3-a36a-2efa83840e9c req-116e210c-5858-447c-9106-8bc5c7da9246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af20b54d-e29d-44d4-80db-b447ceac81c5", "name": "network-vif-plugged", "status": "completed", "tag": "e3101a59-2cca-4f49-b78e-c91a28401eb9"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:43:25.177037 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:43:25.177037 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:43:25.185163 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c6c17ec1-7b25-46f3-a36a-2efa83840e9c req-116e210c-5858-447c-9106-8bc5c7da9246 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:25.185595 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c6c17ec1-7b25-46f3-a36a-2efa83840e9c req-116e210c-5858-447c-9106-8bc5c7da9246 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:25.198063 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-c6c17ec1-7b25-46f3-a36a-2efa83840e9c req-116e210c-5858-447c-9106-8bc5c7da9246 service nova] Creating event network-vif-plugged:e3101a59-2cca-4f49-b78e-c91a28401eb9 for instance af20b54d-e29d-44d4-80db-b447ceac81c5 on hv-cinder-80403 Nov 22 10:43:25.204740 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-c6c17ec1-7b25-46f3-a36a-2efa83840e9c req-116e210c-5858-447c-9106-8bc5c7da9246 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Nov 22 10:43:25.205708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 579/1140] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:43:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:43:25.747378 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:25.748092 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:25.754829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:25.755356 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:25.756106 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:25.756518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:25.899906 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:25.908416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-15ef4686-cf8e-4bfc-a21b-fc30168ab873 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1266 microversion: 2.1 time: 0.164973 Nov 22 10:43:25.909043 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 562/1141] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:25 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:26.926099 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:26.926815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:26.934828 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:26.935347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:26.936226 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:26.936640 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:27.090271 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:27.098922 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-8e7a7af0-6f12-424f-94c2-4ca010afd3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1454 microversion: 2.1 time: 0.176911 Nov 22 10:43:27.099529 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 580/1142] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:26 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1454 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:27.117875 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:43:27.118678 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:43:27.129068 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:27.129560 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:27.130532 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:27.131011 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:27.276463 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:43:27.289408 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a6c01ca1-8c88-4176-9d83-564bdb5621c1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1454 microversion: 2.1 time: 0.176510 Nov 22 10:43:27.290194 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 563/1143] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:43:27 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1454 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:43:29.353162 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-6f710620-837e-497c-be23-49d1066d75da req-a9cf18e2-8323-43e7-8406-cfe1a4a45e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20b54d-e29d-44d4-80db-b447ceac81c5", "tag": "e3101a59-2cca-4f49-b78e-c91a28401eb9"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:43:29.356490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:43:29.356490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:43:29.371490 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6f710620-837e-497c-be23-49d1066d75da req-a9cf18e2-8323-43e7-8406-cfe1a4a45e13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:43:29.372329 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-6f710620-837e-497c-be23-49d1066d75da req-a9cf18e2-8323-43e7-8406-cfe1a4a45e13 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:43:29.398865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-6f710620-837e-497c-be23-49d1066d75da req-a9cf18e2-8323-43e7-8406-cfe1a4a45e13 service nova] Creating event network-changed:e3101a59-2cca-4f49-b78e-c91a28401eb9 for instance af20b54d-e29d-44d4-80db-b447ceac81c5 on hv-cinder-80403 Nov 22 10:43:29.408159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-6f710620-837e-497c-be23-49d1066d75da req-a9cf18e2-8323-43e7-8406-cfe1a4a45e13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060245 Nov 22 10:43:29.409430 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 581/1144] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:43:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:44:51.090219 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:44:51.091101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:44:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:44:59.428916 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:44:59.429588 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:44:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:45:34.742562 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: ERROR oslo.messaging._drivers.impl_rabbit [-] [007dbc69-69a6-4095-8d7a-94ab2d528517] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 22 10:45:34.746240 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:34.746751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:34.753131 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:34.753553 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:34.754335 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:34.754765 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:34.780796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Going to try to terminate instance {{(pid=122857) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:45:34.866113 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-2e786f37-c262-45f6-af5a-fe9f91da0809 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 204 len: 0 microversion: 2.1 time: 0.125229 Nov 22 10:45:34.866767 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 564/1145] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:45:34 2021] DELETE /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:45:34.874750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6da735c3-2051-4198-adfd-d7be3ceeeaed] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Nov 22 10:45:34.878764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:34.879450 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:34.885795 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:34.886239 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:34.887022 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:34.887449 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:35.189559 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:35.197616 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d8e1d974-d01a-44cb-a275-82a268ce0a45 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1579 microversion: 2.1 time: 0.326365 Nov 22 10:45:35.198296 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 582/1146] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:34 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1579 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:45:36.217467 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:36.218197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:36.236751 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:36.237192 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:36.237981 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:36.238416 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:36.243979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] [007dbc69-69a6-4095-8d7a-94ab2d528517] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36828. Nov 22 10:45:36.462695 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:36.471104 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3f442e16-ab90-40da-b161-9d064824fc01 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1579 microversion: 2.1 time: 0.258182 Nov 22 10:45:36.471724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 565/1147] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:36 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1579 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:37.350107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] [6da735c3-2051-4198-adfd-d7be3ceeeaed] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 36836. Nov 22 10:45:37.403012 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-c6a34a6e-8cd8-4f8c-b4e7-260472358bda req-9f2efd8c-8355-4744-abb1-193212f433fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af20b54d-e29d-44d4-80db-b447ceac81c5", "name": "network-vif-deleted", "tag": "e3101a59-2cca-4f49-b78e-c91a28401eb9"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:45:37.405281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:45:37.405281 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:45:37.414484 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c6a34a6e-8cd8-4f8c-b4e7-260472358bda req-9f2efd8c-8355-4744-abb1-193212f433fd service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:37.414929 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-c6a34a6e-8cd8-4f8c-b4e7-260472358bda req-9f2efd8c-8355-4744-abb1-193212f433fd service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:37.427966 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-c6a34a6e-8cd8-4f8c-b4e7-260472358bda req-9f2efd8c-8355-4744-abb1-193212f433fd service nova] Creating event network-vif-deleted:e3101a59-2cca-4f49-b78e-c91a28401eb9 for instance af20b54d-e29d-44d4-80db-b447ceac81c5 on hv-cinder-80403 Nov 22 10:45:37.433762 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-c6a34a6e-8cd8-4f8c-b4e7-260472358bda req-9f2efd8c-8355-4744-abb1-193212f433fd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110959 Nov 22 10:45:37.435243 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 583/1148] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:45:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:45:37.489519 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:37.490129 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:37.497674 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:37.498118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:37.498924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:37.499352 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:37.570182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:37.579114 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f435da42-13df-4b76-a1c7-a6fc29bf4803 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 200 len: 1225 microversion: 2.1 time: 0.093430 Nov 22 10:45:37.579732 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 566/1149] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:37 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:38.596911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:38.597593 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:38.605634 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:38.606088 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:38.606857 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:38.607283 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:38.621093 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] HTTP exception thrown: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. Nov 22 10:45:38.621726 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Returning 404 to user: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:45:38.622584 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-a2e91d0d-ca41-453c-b23e-1f3ccd2e9d36 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 404 len: 111 microversion: 2.1 time: 0.029764 Nov 22 10:45:38.623094 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 584/1150] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:38 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:45:38.728778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1434849577", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102537703", "security_groups": [{"name": "tempest-secgroup-smoke-1365048420"}], "block_device_mapping_v2": [{"uuid": "d4a9ef75-f26a-4c94-a713-cbce7f7211eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7304a1e-1535-4fd7-8c3b-2de67fef34b2"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:45:38.850532 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] validate_networks() for [('f7304a1e-1535-4fd7-8c3b-2de67fef34b2', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:45:39.262609 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:45:39.263036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:45:39.263514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:45:39.263957 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:45:39.264386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:45:39.273817 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:39.274265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:39.275082 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:39.275518 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:39.293244 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:45:39.297862 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for user 026e7d57d6e04ae4bac425987a641b94 and project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:45:39.354974 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:45:39.357169 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4a9ef75-f26a-4c94-a713-cbce7f7211eb',volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:45:39.489558 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cfba73e7-d81b-4207-8c16-939c3fc86baf tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765193 Nov 22 10:45:39.490214 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 567/1151] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:45:38 2021] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:45:39.500468 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-f8635cef-85dc-4370-80cb-519cdf8d2587 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:39.501159 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-f8635cef-85dc-4370-80cb-519cdf8d2587 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:39.555492 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-f8635cef-85dc-4370-80cb-519cdf8d2587 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:39.562619 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-f8635cef-85dc-4370-80cb-519cdf8d2587 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1095 microversion: 2.1 time: 0.065771 Nov 22 10:45:39.563204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 585/1152] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:39 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:40.580491 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:40.581428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:40.590579 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:40.591330 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:40.592251 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:40.592785 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:40.661492 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:40.671195 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a9b00d08-ccfa-4ab8-b4b8-1e49f663a881 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1211 microversion: 2.1 time: 0.094965 Nov 22 10:45:40.671768 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 568/1153] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:40 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1211 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:41.688930 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:41.689939 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:41.700536 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:41.701166 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:41.702020 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:41.702601 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:41.949503 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:41.958874 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0d4efd29-792c-4a9c-85e0-5e27f234278e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.273343 Nov 22 10:45:41.959758 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 586/1154] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:41 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:42.140660 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-0b098abb-384d-4467-ba92-a610f8b96152 req-84a054b8-7f38-4b1b-a407-79e5321a3626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa805b0-27a2-414c-afa8-0fb6e09c07c9", "tag": "26065c2f-a918-44a5-ac36-c7046284fb05"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:45:42.142758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:45:42.142758 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:45:42.152829 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-0b098abb-384d-4467-ba92-a610f8b96152 req-84a054b8-7f38-4b1b-a407-79e5321a3626 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:42.153654 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-0b098abb-384d-4467-ba92-a610f8b96152 req-84a054b8-7f38-4b1b-a407-79e5321a3626 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:42.168507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-0b098abb-384d-4467-ba92-a610f8b96152 req-84a054b8-7f38-4b1b-a407-79e5321a3626 service nova] Creating event network-changed:26065c2f-a918-44a5-ac36-c7046284fb05 for instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 on hv-cinder-80403 Nov 22 10:45:42.174455 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-0b098abb-384d-4467-ba92-a610f8b96152 req-84a054b8-7f38-4b1b-a407-79e5321a3626 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043814 Nov 22 10:45:42.175255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 569/1155] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:45:42.977068 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:42.977672 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:42.984472 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:42.984919 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:42.985699 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:42.986125 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:43.219147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:43.227218 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-2282bde4-4ad2-4448-a52d-79084570026d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.253768 Nov 22 10:45:43.227847 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 587/1156] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:42 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:44.245665 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:44.246425 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:44.253478 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:44.253921 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:44.254693 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:44.255117 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:44.396515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:44.404616 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-cbe37acc-7842-4093-979a-429caa4b63e3 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.163785 Nov 22 10:45:44.405215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 570/1157] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:44 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:45.421362 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:45.422018 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:45.428723 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:45.429168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:45.429951 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:45.430379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:45.577054 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:45.585441 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3d8453ac-96bc-4fcc-9574-290dc7722764 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.167841 Nov 22 10:45:45.586038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 588/1158] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:45 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:46.602860 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:46.603515 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:46.610844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:46.611293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:46.612101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:46.612534 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:46.751477 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:46.759293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0048ec57-7c87-4f30-b650-fb14387a8c53 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.160264 Nov 22 10:45:46.759911 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 571/1159] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:46 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:47.777285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:47.777943 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:47.784691 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:47.785143 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:47.785947 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:47.786367 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:47.931514 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:47.940045 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e2dfdc56-39ea-4830-8938-9b8e1f0b56e9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.166699 Nov 22 10:45:47.940631 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 589/1160] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:47 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:48.957849 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:48.958936 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:48.966102 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:48.966551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:48.967359 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:48.967827 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:49.106446 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:49.114550 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-d1b60128-3a1c-4b7a-9dcd-307d4b5e166d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.160667 Nov 22 10:45:49.115124 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 572/1161] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:48 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:50.137387 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:50.138043 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:50.145502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:50.145958 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:50.146759 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:50.147156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:50.295495 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:50.303211 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5e19085e-0497-44e0-80b9-ed2acb12933a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.175045 Nov 22 10:45:50.303851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 590/1162] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:50 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:51.323587 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:51.324462 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:51.331353 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:51.331831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:51.332607 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:51.333039 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:51.471965 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:51.479925 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f760cad0-5b16-4e9d-a160-c3a499eaff94 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.160282 Nov 22 10:45:51.480637 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 573/1163] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:51 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:52.111028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-86c5af55-b94b-45ce-b6c3-635d81617174 req-bfc0813a-a4cd-424c-a83f-8ca21b257e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa805b0-27a2-414c-afa8-0fb6e09c07c9", "name": "network-vif-plugged", "status": "completed", "tag": "26065c2f-a918-44a5-ac36-c7046284fb05"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:45:52.112815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:45:52.112815 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:45:52.120191 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-86c5af55-b94b-45ce-b6c3-635d81617174 req-bfc0813a-a4cd-424c-a83f-8ca21b257e2a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:52.120641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-86c5af55-b94b-45ce-b6c3-635d81617174 req-bfc0813a-a4cd-424c-a83f-8ca21b257e2a service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:52.131956 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-86c5af55-b94b-45ce-b6c3-635d81617174 req-bfc0813a-a4cd-424c-a83f-8ca21b257e2a service nova] Creating event network-vif-plugged:26065c2f-a918-44a5-ac36-c7046284fb05 for instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 on hv-cinder-80403 Nov 22 10:45:52.137594 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-86c5af55-b94b-45ce-b6c3-635d81617174 req-bfc0813a-a4cd-424c-a83f-8ca21b257e2a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093024 Nov 22 10:45:52.138352 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 591/1164] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:45:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:45:52.497800 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:52.498372 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:52.505212 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:52.505655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:52.506428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:52.506854 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:52.649944 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:52.657926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-425d4951-0d94-4d07-9309-bb8c68f3299b tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1267 microversion: 2.1 time: 0.164490 Nov 22 10:45:52.658498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 574/1165] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:52 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:53.675901 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:53.676597 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:53.683751 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:53.684185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:53.684969 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:53.685392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:53.873247 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:53.881882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6281fe23-ee0b-46d5-ae75-39d596dabe1a tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1454 microversion: 2.1 time: 0.210368 Nov 22 10:45:53.882706 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 592/1166] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:53 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1454 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:53.899489 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:45:53.900137 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:45:53.907692 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:53.908185 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:53.908976 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:53.909397 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:54.145701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:45:54.154958 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-c8fc9d6f-e19c-432b-9fef-b34d303fd462 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1454 microversion: 2.1 time: 0.259226 Nov 22 10:45:54.155554 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 575/1167] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:45:53 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1454 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:45:55.989107 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-3bfb2896-0862-47c7-afe3-cabae05c19f7 req-6daf2200-dca1-4c33-9a6d-a55be3e2c9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa805b0-27a2-414c-afa8-0fb6e09c07c9", "tag": "26065c2f-a918-44a5-ac36-c7046284fb05"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:45:55.990752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:45:55.990752 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:45:55.998712 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-3bfb2896-0862-47c7-afe3-cabae05c19f7 req-6daf2200-dca1-4c33-9a6d-a55be3e2c9f9 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:45:55.999047 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-3bfb2896-0862-47c7-afe3-cabae05c19f7 req-6daf2200-dca1-4c33-9a6d-a55be3e2c9f9 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:45:56.010968 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-3bfb2896-0862-47c7-afe3-cabae05c19f7 req-6daf2200-dca1-4c33-9a6d-a55be3e2c9f9 service nova] Creating event network-changed:26065c2f-a918-44a5-ac36-c7046284fb05 for instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 on hv-cinder-80403 Nov 22 10:45:56.016415 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-3bfb2896-0862-47c7-afe3-cabae05c19f7 req-6daf2200-dca1-4c33-9a6d-a55be3e2c9f9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094503 Nov 22 10:45:56.017028 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 593/1168] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:45:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:46:43.454129 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:46:43.454911 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:46:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:47:29.886100 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-375714549", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2102537703", "security_groups": [{"name": "tempest-secgroup-smoke-1365048420"}], "block_device_mapping_v2": [{"uuid": "2ae93dc7-0831-4fe7-82dd-e8f88387adf1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f7304a1e-1535-4fd7-8c3b-2de67fef34b2"}]}} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:47:30.007848 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.network.neutron [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] validate_networks() for [('f7304a1e-1535-4fd7-8c3b-2de67fef34b2', None, None, None, None, None)] {{(pid=122857) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 10:47:30.410119 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 10:47:30.410539 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image limits 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 10:47:30.411473 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Flavor pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 10:47:30.412087 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Image pref 0:0:0 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 10:47:30.412690 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.virt.hardware [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 10:47:30.421778 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:30.422216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:30.423009 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:30.423434 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:30.440748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 10:47:30.445166 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.quota [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Getting quotas for user 026e7d57d6e04ae4bac425987a641b94 and project 3f1c47419b1b4aceb6eb91d5f6328985. Resources: {'cores', 'instances', 'ram'} {{(pid=122857) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 10:47:30.503831 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Going to run 1 instances... {{(pid=122857) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 10:47:30.506115 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ae93dc7-0831-4fe7-82dd-e8f88387adf1',volume_size=None,volume_type=None)] {{(pid=122857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 10:47:30.653995 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-34908382-61f4-4099-a9ac-32c615977a0d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772489 Nov 22 10:47:30.654648 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 576/1169] 10.222.0.46 () {60 vars in 1146 bytes} [Mon Nov 22 10:47:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 10:47:30.667499 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-0b4ae474-caa2-441c-a0b8-83c48a8eeeff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:30.668571 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-0b4ae474-caa2-441c-a0b8-83c48a8eeeff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:30.727350 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-0b4ae474-caa2-441c-a0b8-83c48a8eeeff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:30.734673 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-0b4ae474-caa2-441c-a0b8-83c48a8eeeff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1094 microversion: 2.1 time: 0.073591 Nov 22 10:47:30.735255 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 594/1170] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:30 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:47:31.753055 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ca73742e-46f3-4017-b02c-ab143bb99ed2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:31.753722 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ca73742e-46f3-4017-b02c-ab143bb99ed2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:31.809529 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ca73742e-46f3-4017-b02c-ab143bb99ed2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:31.816913 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ca73742e-46f3-4017-b02c-ab143bb99ed2 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1094 microversion: 2.1 time: 0.068256 Nov 22 10:47:31.817585 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 577/1171] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:31 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:47:32.835031 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-81c7a46c-c481-4552-ab7a-0b13f1ac1469 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:32.835652 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-81c7a46c-c481-4552-ab7a-0b13f1ac1469 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:32.891103 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-81c7a46c-c481-4552-ab7a-0b13f1ac1469 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:32.898598 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-81c7a46c-c481-4552-ab7a-0b13f1ac1469 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1094 microversion: 2.1 time: 0.067975 Nov 22 10:47:32.899138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 595/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:32 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:33.916504 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-586148df-6ece-425e-8e17-98d4532491ff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:33.917122 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-586148df-6ece-425e-8e17-98d4532491ff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:33.975219 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-586148df-6ece-425e-8e17-98d4532491ff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:33.981952 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-586148df-6ece-425e-8e17-98d4532491ff tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1094 microversion: 2.1 time: 0.070069 Nov 22 10:47:33.982534 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 578/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:33 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:35.000491 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:35.001185 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:35.008996 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:35.009442 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:35.010231 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:35.010661 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:35.079112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:35.087814 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-552bfdf8-952a-44fb-ae76-695581b1c905 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1144 microversion: 2.1 time: 0.091091 Nov 22 10:47:35.088388 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 596/1174] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:34 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:36.105687 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:36.106756 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:36.114514 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:36.114890 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:36.115734 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:36.116276 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:36.189948 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:36.198615 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-ad092c06-c960-4fcf-9ab1-a147f6d38154 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1210 microversion: 2.1 time: 0.097072 Nov 22 10:47:36.203402 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 579/1175] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:36 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:37.172374 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [req-54e0a9af-2645-42c0-a646-ca8d4dbd707a req-b12e3287-441d-4811-9e27-d6947b12b45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958", "tag": "d55cac52-a1c8-4010-a964-70aa95d07e5f"}]} {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:47:37.175392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:47:37.175392 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: warnings.warn(msg) Nov 22 10:47:37.185692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-54e0a9af-2645-42c0-a646-ca8d4dbd707a req-b12e3287-441d-4811-9e27-d6947b12b45f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:37.186156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [req-54e0a9af-2645-42c0-a646-ca8d4dbd707a req-b12e3287-441d-4811-9e27-d6947b12b45f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:37.203158 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.compute.server_external_events [req-54e0a9af-2645-42c0-a646-ca8d4dbd707a req-b12e3287-441d-4811-9e27-d6947b12b45f service nova] Creating event network-changed:d55cac52-a1c8-4010-a964-70aa95d07e5f for instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 on hv-cinder-80403 Nov 22 10:47:37.208522 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [req-54e0a9af-2645-42c0-a646-ca8d4dbd707a req-b12e3287-441d-4811-9e27-d6947b12b45f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039840 Nov 22 10:47:37.209840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 597/1176] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:47:37.216779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:37.217395 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:37.223634 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:37.224176 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:37.225163 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:37.225605 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:37.461066 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:37.469497 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1059df6d-e60d-4d08-b4da-3a21f33f78fa tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.256522 Nov 22 10:47:37.470120 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 580/1177] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:37 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:38.488145 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:38.489115 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:38.496921 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:38.497487 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:38.498360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:38.498704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:38.647551 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:38.656106 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-98bb5f72-4ab3-4eb4-8f5b-29cdbdd0745d tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.173217 Nov 22 10:47:38.656596 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 598/1178] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:38 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:39.673385 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:39.673993 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:39.681401 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:39.681844 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:39.683012 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:39.683441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:39.826048 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:39.834629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-a2515fcc-cb10-4fe5-ab2d-b228f70b1138 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.164591 Nov 22 10:47:39.835197 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 581/1179] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:39 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:40.852193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:40.852839 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:40.860112 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:40.860572 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:40.861379 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:40.861840 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:41.007908 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:41.016223 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5c46b33c-4c2c-46a0-b2e3-c5c8c16857e7 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.168359 Nov 22 10:47:41.016853 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 599/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:40 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:42.034033 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:42.034779 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:42.041664 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:42.042131 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:42.042943 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:42.043782 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:42.199398 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:42.212480 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-9e187e72-460e-4647-8926-a1f4a031dab5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.181967 Nov 22 10:47:42.213246 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 582/1181] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:42 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:43.234410 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:43.235133 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:43.242369 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:43.242824 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:43.243615 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:43.244078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:43.380283 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:43.389486 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-e83e65e8-2d94-44c6-9b8c-cd83acf20184 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.158885 Nov 22 10:47:43.390056 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 600/1182] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:43 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:44.530821 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:44.531444 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:44.538222 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:44.538639 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:44.539450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:44.539926 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:44.681450 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:44.689635 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-f67b2628-10b9-49b4-a488-e9d807f22120 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.286093 Nov 22 10:47:44.690216 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 583/1183] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:44 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:45.707147 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:45.707859 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:45.715360 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:45.715842 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:45.716641 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:45.717073 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:45.865187 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:45.873289 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-92c81c7c-b155-4527-a85b-da648e7abb62 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.170250 Nov 22 10:47:45.873868 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 601/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:45 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:46.890651 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:46.891278 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:46.897968 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:46.898412 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:46.899893 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:46.900323 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:47.052851 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:47.061101 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-dce1bcb6-e150-4160-92c0-860ba462ef6f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.174438 Nov 22 10:47:47.061670 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 584/1185] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:46 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:48.078881 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:48.079517 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:48.086725 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:48.087180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:48.088038 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:48.088471 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:48.234108 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:48.243612 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6bb5f233-6cdf-47b1-9d35-d5bdb6d24727 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.168481 Nov 22 10:47:48.244229 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 602/1186] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:48 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:48.502189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-f7579b06-2ef6-48c6-9671-51394471b5e0 req-aa17a94f-e22e-44b5-bad6-161ed4b9791d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958", "name": "network-vif-plugged", "status": "completed", "tag": "d55cac52-a1c8-4010-a964-70aa95d07e5f"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:47:48.503856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:47:48.503856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:47:48.511493 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f7579b06-2ef6-48c6-9671-51394471b5e0 req-aa17a94f-e22e-44b5-bad6-161ed4b9791d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:48.511989 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-f7579b06-2ef6-48c6-9671-51394471b5e0 req-aa17a94f-e22e-44b5-bad6-161ed4b9791d service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:48.523915 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-f7579b06-2ef6-48c6-9671-51394471b5e0 req-aa17a94f-e22e-44b5-bad6-161ed4b9791d service nova] Creating event network-vif-plugged:d55cac52-a1c8-4010-a964-70aa95d07e5f for instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 on hv-cinder-80403 Nov 22 10:47:48.528979 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-f7579b06-2ef6-48c6-9671-51394471b5e0 req-aa17a94f-e22e-44b5-bad6-161ed4b9791d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030533 Nov 22 10:47:48.529613 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 585/1187] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:47:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:47:49.262851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:49.263579 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:49.271202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:49.271799 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:49.272708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:49.273204 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:49.425072 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:49.433402 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-6648e26e-495d-4619-99eb-5be1b653108e tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1266 microversion: 2.1 time: 0.175405 Nov 22 10:47:49.434078 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 603/1188] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:49 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:50.452053 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:50.452781 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:50.459759 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:50.460234 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:50.461024 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:50.461914 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:50.603149 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:50.611238 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-96534f7f-8041-43ad-a636-684bd49d8edd tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1454 microversion: 2.1 time: 0.163912 Nov 22 10:47:50.611856 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 586/1189] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:50 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:50.627742 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:47:50.628385 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:47:50.635557 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:50.636041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:50.636820 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:50.637251 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:50.786865 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:47:50.795238 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cffcddde-9348-4ec1-a8ed-128094d9ab22 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1454 microversion: 2.1 time: 0.171247 Nov 22 10:47:50.795827 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 604/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:47:50 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:47:52.541143 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-17f0eb64-f941-4fe5-854a-8d3931aa2cdd req-62a93937-8d71-4778-9153-550adfa37f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958", "tag": "d55cac52-a1c8-4010-a964-70aa95d07e5f"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:47:52.542659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:47:52.542659 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:47:52.550655 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-17f0eb64-f941-4fe5-854a-8d3931aa2cdd req-62a93937-8d71-4778-9153-550adfa37f12 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:47:52.551411 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-17f0eb64-f941-4fe5-854a-8d3931aa2cdd req-62a93937-8d71-4778-9153-550adfa37f12 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:47:52.563057 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-17f0eb64-f941-4fe5-854a-8d3931aa2cdd req-62a93937-8d71-4778-9153-550adfa37f12 service nova] Creating event network-changed:d55cac52-a1c8-4010-a964-70aa95d07e5f for instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 on hv-cinder-80403 Nov 22 10:47:52.568189 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-17f0eb64-f941-4fe5-854a-8d3931aa2cdd req-62a93937-8d71-4778-9153-550adfa37f12 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 Nov 22 10:47:52.568980 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 587/1191] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:47:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:48:11.109428 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:48:11.110182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:48:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:48:19.447153 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:48:19.447851 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:48:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:49:24.537914 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:24.538629 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:24.542619 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-56e26837-ea49-42bf-9b05-1f87864746b5 req-691eeead-1a4a-4f2a-a764-b6a9b00f8491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958", "tag": "d55cac52-a1c8-4010-a964-70aa95d07e5f"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:49:24.544498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:49:24.544498 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:49:24.545167 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:24.545621 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:24.546686 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:24.547372 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:24.552371 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-56e26837-ea49-42bf-9b05-1f87864746b5 req-691eeead-1a4a-4f2a-a764-b6a9b00f8491 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:24.552924 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-56e26837-ea49-42bf-9b05-1f87864746b5 req-691eeead-1a4a-4f2a-a764-b6a9b00f8491 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:24.566386 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-56e26837-ea49-42bf-9b05-1f87864746b5 req-691eeead-1a4a-4f2a-a764-b6a9b00f8491 service nova] Creating event network-changed:d55cac52-a1c8-4010-a964-70aa95d07e5f for instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 on hv-cinder-80403 Nov 22 10:49:24.573689 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-56e26837-ea49-42bf-9b05-1f87864746b5 req-691eeead-1a4a-4f2a-a764-b6a9b00f8491 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Nov 22 10:49:24.574589 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:49:24.574725 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 588/1192] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:49:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:49:24.659433 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3b0c0e24-b3c9-4cbc-a4f7-a36a1736ec02 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 204 len: 0 microversion: 2.1 time: 0.127025 Nov 22 10:49:24.660146 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 605/1193] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:49:24 2021] DELETE /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:49:24.671441 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:24.672277 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:24.678686 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:24.679215 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:24.680118 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:24.680636 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:24.915269 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:24.924650 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-1796fda8-c54e-4acd-ad59-5708bece7d99 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1579 microversion: 2.1 time: 0.259378 Nov 22 10:49:24.936629 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 589/1194] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:24 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1579 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:49:25.945755 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:25.946370 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:25.953237 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:25.953704 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:25.954489 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:25.954917 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:26.116967 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:26.123879 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-53e86bed-4e92-44fc-8e0f-569d3149128f tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1460 microversion: 2.1 time: 0.182517 Nov 22 10:49:26.124470 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 606/1195] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:25 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1460 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:49:26.823749 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-e8f089ad-14bd-4465-9330-0cf3aef9361f req-2685b06b-5352-4e8c-9cda-792175111f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958", "name": "network-vif-deleted", "tag": "d55cac52-a1c8-4010-a964-70aa95d07e5f"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:49:26.825438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:49:26.825438 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:49:26.837604 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-e8f089ad-14bd-4465-9330-0cf3aef9361f req-2685b06b-5352-4e8c-9cda-792175111f9f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:26.838182 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-e8f089ad-14bd-4465-9330-0cf3aef9361f req-2685b06b-5352-4e8c-9cda-792175111f9f service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:26.856701 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-e8f089ad-14bd-4465-9330-0cf3aef9361f req-2685b06b-5352-4e8c-9cda-792175111f9f service nova] Creating event network-vif-deleted:d55cac52-a1c8-4010-a964-70aa95d07e5f for instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 on hv-cinder-80403 Nov 22 10:49:26.862586 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-e8f089ad-14bd-4465-9330-0cf3aef9361f req-2685b06b-5352-4e8c-9cda-792175111f9f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042776 Nov 22 10:49:26.863229 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 590/1196] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:49:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:49:27.142784 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:27.144138 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:27.155245 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:27.155803 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:27.156707 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:27.157252 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:27.193937 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:27.194664 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:27.195105 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lazy-loading 'fault' on Instance uuid 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:49:27.240119 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:27.248285 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-bc89350f-3d61-42ae-b69f-4368f5027000 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 200 len: 1230 microversion: 2.1 time: 0.109218 Nov 22 10:49:27.248796 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 607/1197] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:27 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:49:28.268004 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:28.268748 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:28.276471 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:28.276927 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:28.277744 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:28.278186 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:28.293066 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] HTTP exception thrown: Instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 could not be found. Nov 22 10:49:28.293694 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Returning 404 to user: Instance 5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:49:28.294551 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-3e40ba09-dde2-46b8-a0d4-2c4fbad22733 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958" status: 404 len: 111 microversion: 2.1 time: 0.031381 Nov 22 10:49:28.295141 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 591/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:28 2021] GET /compute/v2.1/servers/5ae56d4a-e3a9-4a48-a7bc-22d7a90a8958 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:49:31.760168 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:31.760763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:31.763127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-da21017d-b686-4381-a24e-38e252467f3f req-386520c3-d81e-43e1-82c3-dac2a03d21f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa805b0-27a2-414c-afa8-0fb6e09c07c9", "tag": "26065c2f-a918-44a5-ac36-c7046284fb05"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:49:31.764743 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:49:31.764743 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:49:31.768701 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:31.769156 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:31.769971 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:31.770405 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:31.773105 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-da21017d-b686-4381-a24e-38e252467f3f req-386520c3-d81e-43e1-82c3-dac2a03d21f6 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:31.773628 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-da21017d-b686-4381-a24e-38e252467f3f req-386520c3-d81e-43e1-82c3-dac2a03d21f6 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:31.789440 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-da21017d-b686-4381-a24e-38e252467f3f req-386520c3-d81e-43e1-82c3-dac2a03d21f6 service nova] Creating event network-changed:26065c2f-a918-44a5-ac36-c7046284fb05 for instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 on hv-cinder-80403 Nov 22 10:49:31.797245 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-da21017d-b686-4381-a24e-38e252467f3f req-386520c3-d81e-43e1-82c3-dac2a03d21f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038345 Nov 22 10:49:31.798122 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Going to try to terminate instance {{(pid=122858) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 10:49:31.798557 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 592/1199] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:49:31.925377 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-db3b953d-8b16-41e8-ab9e-df857e5a5450 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "DELETE /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 204 len: 0 microversion: 2.1 time: 0.168057 Nov 22 10:49:31.928316 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 608/1200] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:49:31 2021] DELETE /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 10:49:31.938208 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:31.938907 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:31.945622 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:31.946070 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:31.946904 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:31.947348 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:32.224799 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.policy [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122857) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:32.234036 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-15c52b0e-fd02-479a-9b18-15cf7d229c14 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1579 microversion: 2.1 time: 0.299911 Nov 22 10:49:32.235015 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 593/1201] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:31 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1579 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 10:49:33.254180 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:33.254856 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:33.263041 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:33.263507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:33.264337 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:33.264793 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:33.420868 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:33.429682 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-5bc95732-c229-4aaa-8b35-5a85e92cd7a5 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1460 microversion: 2.1 time: 0.179657 Nov 22 10:49:33.430310 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 609/1202] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:33 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1460 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:49:33.961255 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [req-80965bb4-f14a-459b-9515-3167d3da5d20 req-5f75cc11-0b73-41c3-817b-05a3ac0776a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa805b0-27a2-414c-afa8-0fb6e09c07c9", "name": "network-vif-deleted", "tag": "26065c2f-a918-44a5-ac36-c7046284fb05"}]} {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 10:49:33.964569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 10:49:33.964569 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: warnings.warn(msg) Nov 22 10:49:33.978949 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-80965bb4-f14a-459b-9515-3167d3da5d20 req-5f75cc11-0b73-41c3-817b-05a3ac0776a4 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:33.979832 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [req-80965bb4-f14a-459b-9515-3167d3da5d20 req-5f75cc11-0b73-41c3-817b-05a3ac0776a4 service nova] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:34.002110 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.compute.server_external_events [req-80965bb4-f14a-459b-9515-3167d3da5d20 req-5f75cc11-0b73-41c3-817b-05a3ac0776a4 service nova] Creating event network-vif-deleted:26065c2f-a918-44a5-ac36-c7046284fb05 for instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 on hv-cinder-80403 Nov 22 10:49:34.011328 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [req-80965bb4-f14a-459b-9515-3167d3da5d20 req-5f75cc11-0b73-41c3-817b-05a3ac0776a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057264 Nov 22 10:49:34.012487 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 594/1203] 10.222.0.46 () {64 vars in 1317 bytes} [Mon Nov 22 10:49:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 10:49:34.457884 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:34.458802 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:34.470618 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:34.471193 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:34.472961 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:34.473202 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:34.514347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:34.514347 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:34.514636 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.objects.instance [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lazy-loading 'fault' on Instance uuid 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 {{(pid=122858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 10:49:34.581036 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.policy [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026e7d57d6e04ae4bac425987a641b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f1c47419b1b4aceb6eb91d5f6328985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122858) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 10:49:34.597096 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-d887a9fd-7376-4b08-ba02-f750e6c00b76 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 200 len: 1231 microversion: 2.1 time: 0.143351 Nov 22 10:49:34.598348 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 610/1204] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:34 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 1231 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 10:49:35.627198 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:35.627956 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: 4aa805b0-27a2-414c-afa8-0fb6e09c07c9] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:35.635320 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:35.636054 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:35.636881 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:35.637329 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:35.653127 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] HTTP exception thrown: Instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 could not be found. Nov 22 10:49:35.653796 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Returning 404 to user: Instance 4aa805b0-27a2-414c-afa8-0fb6e09c07c9 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:49:35.654724 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-0f1aedb2-4e3a-4eba-a096-440bc4b4bbb1 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9" status: 404 len: 111 microversion: 2.1 time: 0.033029 Nov 22 10:49:35.655345 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 595/1205] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:35 2021] GET /compute/v2.1/servers/4aa805b0-27a2-414c-afa8-0fb6e09c07c9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:49:36.177783 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:36.178502 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.compute.api [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122858) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:36.185576 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:36.186032 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:36.186867 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:36.187301 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG oslo_concurrency.lockutils [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:36.202692 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.wsgi [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] HTTP exception thrown: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. Nov 22 10:49:36.203325 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Returning 404 to user: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. {{(pid=122858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:49:36.204215 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-cb84844c-2a14-43eb-9ae8-98e006a2a3ed tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 404 len: 111 microversion: 2.1 time: 0.030405 Nov 22 10:49:36.204789 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 611/1206] 10.222.0.46 () {58 vars in 1238 bytes} [Mon Nov 22 10:49:36 2021] DELETE /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:49:36.216179 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '>' {{(pid=122857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:36.216872 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.compute.api [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] [instance: af20b54d-e29d-44d4-80db-b447ceac81c5] Fetching instance by UUID {{(pid=122857) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 10:49:36.223820 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:36.224265 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:36.225074 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 10:49:36.225507 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG oslo_concurrency.lockutils [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Lock "591e4b4b-d12e-4b86-9966-9fa5b93cdbbd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 10:49:36.241300 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.wsgi [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] HTTP exception thrown: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. Nov 22 10:49:36.241950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: DEBUG nova.api.openstack.wsgi [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Returning 404 to user: Instance af20b54d-e29d-44d4-80db-b447ceac81c5 could not be found. {{(pid=122857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 10:49:36.243203 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO nova.api.openstack.requestlog [None req-86e32c5e-358c-4641-a580-cc07278690b4 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5" status: 404 len: 111 microversion: 2.1 time: 0.032375 Nov 22 10:49:36.244362 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: [pid: 122857|app: 0|req: 596/1207] 10.222.0.46 () {58 vars in 1235 bytes} [Mon Nov 22 10:49:36 2021] GET /compute/v2.1/servers/af20b54d-e29d-44d4-80db-b447ceac81c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 10:49:37.615763 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: DEBUG nova.api.openstack.wsgi [None req-3f835be0-9a0a-4865-913a-877a15ebd8c9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] Calling method '.version_select at 0x7f1a5932faf0>' {{(pid=122858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 10:49:37.650750 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO nova.api.openstack.requestlog [None req-3f835be0-9a0a-4865-913a-877a15ebd8c9 tempest-TestVolumeBootPattern-1874596279 tempest-TestVolumeBootPattern-1874596279-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2102537703" status: 202 len: 0 microversion: 2.1 time: 0.038840 Nov 22 10:49:37.651882 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: [pid: 122858|app: 0|req: 612/1208] 10.222.0.46 () {58 vars in 1262 bytes} [Mon Nov 22 10:49:37 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2102537703 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 10:49:46.304556 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:49:46.305483 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:49:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:50:03.473708 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:50:03.474322 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:50:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:51:31.134191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:51:31.134191 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:51:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:53:06.339072 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:53:06.339950 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:53:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:53:23.493764 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:53:23.494507 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:53:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:54:51.154089 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:54:51.154986 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:54:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:54:59.478359 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:54:59.479148 dv-cinder-804035-13-iscsi devstack@n-api.service[122858]: Mon Nov 22 10:54:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 10:55:06.251461 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 10:55:06.252293 dv-cinder-804035-13-iscsi devstack@n-api.service[122857]: Mon Nov 22 10:55:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!